-- Logs begin at Wed 2022-08-17 18:26:35 UTC, end at Wed 2022-08-17 20:03:04 UTC. -- Aug 17 19:30:38.975860 dv-cinder-850698-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 19:30:38.985968 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 19:30:38.988726 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 19:30:38 2022] *** Aug 17 19:30:38.988726 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 19:30:38.988726 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 19:30:38.988726 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: nodename: dv-cinder-850698-2-iscsi Aug 17 19:30:38.988726 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: machine: x86_64 Aug 17 19:30:38.988726 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: clock source: unix Aug 17 19:30:38.988726 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: pcre jit disabled Aug 17 19:30:38.988726 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: detected number of CPU cores: 4 Aug 17 19:30:38.988726 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: current working directory: / Aug 17 19:30:38.988726 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: detected binary path: /usr/bin/uwsgi-core Aug 17 19:30:38.989906 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: your processes number limit is 47680 Aug 17 19:30:38.989906 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: your memory page size is 4096 bytes Aug 17 19:30:38.989906 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: detected max file descriptor number: 2048 Aug 17 19:30:38.989906 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: lock engine: pthread robust mutexes Aug 17 19:30:38.989906 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: thunder lock: enabled Aug 17 19:30:38.989906 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 19:30:38.989906 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 19:30:39.028356 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: Python main interpreter initialized at 0x5620b83ef9c0 Aug 17 19:30:39.028356 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: python threads support enabled Aug 17 19:30:39.028356 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: your server socket listen backlog is limited to 100 connections Aug 17 19:30:39.028356 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: your mercy for graceful operations on workers is 90 seconds Aug 17 19:30:39.028781 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 19:30:39.028781 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: *** Operational MODE: preforking *** Aug 17 19:30:39.029058 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: *** uWSGI is running in multiple interpreter mode *** Aug 17 19:30:39.029058 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: spawned uWSGI master process (pid: 106839) Aug 17 19:30:39.029296 dv-cinder-850698-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 19:30:39.029856 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: spawned uWSGI worker 1 (pid: 106843, cores: 1) Aug 17 19:30:39.030185 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: spawned uWSGI worker 2 (pid: 106844, cores: 1) Aug 17 19:30:39.030346 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 19:30:39.715378 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 19:30:39.718550 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 19:30:40.823065 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:30:40.823065 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: from cryptography.utils import int_from_bytes Aug 17 19:30:40.823872 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:30:40.823872 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: from cryptography.utils import int_from_bytes Aug 17 19:30:40.824275 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:30:40.824275 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: from cryptography.utils import int_from_bytes Aug 17 19:30:40.824412 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:30:40.824412 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: from cryptography.utils import int_from_bytes Aug 17 19:30:43.390940 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:30:43.391606 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:30:43.391754 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:30:43.391875 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:30:43.392425 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:30:43.392575 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:30:43.392575 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:30:43.392790 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:30:43.392920 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.393054 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:30:43.393201 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.393392 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:30:43.393532 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.393643 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.393721 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.393934 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.394084 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.394286 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.394439 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.394579 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.394684 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.394918 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.395016 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.395230 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.395338 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.395507 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.395724 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.395841 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.395922 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.396127 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850698-2-iscsi {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.396250 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.396447 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.396572 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.396753 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.396846 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.397065 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.397160 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850698-2-iscsi {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.397451 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.397547 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.397764 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.397889 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.398081 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.398175 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.398401 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.398500 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.398706 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.398905 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.399321 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.399321 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.399588 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.399774 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.399935 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.400111 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.400259 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.400427 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.400562 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.400743 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.400890 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.401078 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.401247 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.401424 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.401629 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.401774 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.401981 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.402128 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.402298 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.402497 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.402679 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.402679 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.402930 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850698-2-iscsi {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.403022 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.403179 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.403338 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.403437 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850698-2-iscsi {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.403658 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.403814 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.404026 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.404186 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.404340 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.404516 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.404666 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.404867 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.405082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.405280 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.405394 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.405537 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.405630 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.405746 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.405940 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.406089 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.406235 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.406366 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.406562 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.406711 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.406883 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.406979 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.407184 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.407321 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.407478 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.407625 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.407797 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.407925 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.408178 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.408309 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.408492 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.408642 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.408801 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.408920 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.409050 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.409190 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.409382 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.409486 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.409677 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.409791 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.409992 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.410089 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.410324 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.410460 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.410595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.410728 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.410874 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.411026 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.411197 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.411336 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.411477 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.411604 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.411761 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.412009 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.412220 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.412433 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.412588 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.412759 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.412932 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.413086 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.413283 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.413414 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.413543 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.413666 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.413807 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.413943 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.414051 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.414174 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.414174 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.414475 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.414591 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.414804 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.414940 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.415466 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.415635 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.415805 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.415989 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.416122 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.416233 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.416394 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.416591 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.416591 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.416889 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.416889 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.417460 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.417607 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.417783 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.417913 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.418041 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.418186 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.418353 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.418804 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.418965 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.419125 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.419304 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.419304 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.419673 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.419673 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.419972 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.420146 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.420310 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.420467 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.420657 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.420988 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.421129 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.421312 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.421505 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.421505 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.421795 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.421961 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.422115 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.422301 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.422445 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.422445 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.422834 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.422985 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.423145 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.423145 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.423419 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.423605 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.424302 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.424411 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.424502 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.424602 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.424689 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.424798 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.424890 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.424969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.425137 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.425310 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.425442 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.425566 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.425701 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.425836 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.425974 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.426091 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.426222 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.426326 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.426459 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.426583 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.426707 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.426835 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.426977 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.427102 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.427246 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.427396 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.427520 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.427666 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.427787 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.427879 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.428032 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.428165 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.428285 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.428384 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.428541 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.428689 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.428883 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.429024 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.429194 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.429436 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.429556 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.429674 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.429797 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.429931 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.430067 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.430164 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.430252 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.430331 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.430421 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.430518 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.430652 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.430735 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.430827 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.430937 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.431059 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.431157 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.431258 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.431439 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.431573 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.431754 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.431862 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.432057 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.432146 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.432366 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.432457 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.432675 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.432791 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.432980 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.433070 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.433309 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.433455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.433618 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.433764 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.433925 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.434012 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.434222 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.434316 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.434530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.434632 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.434850 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.434935 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.435162 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.435261 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.435469 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.435568 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.435776 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.435871 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.436083 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.436168 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.436408 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:30:43.436515 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.436751 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.436903 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.437064 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.437286 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.437513 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.437659 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.437803 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.437962 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.438107 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.438267 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.438424 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.438570 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.438716 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.438865 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.439072 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.439212 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.440007 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.440152 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.440292 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.440445 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.440589 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.440753 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.440896 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.441041 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.441182 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.441372 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.441509 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.441664 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.441836 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.441986 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.442124 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.442268 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.442412 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.442567 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.442730 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.442881 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.443039 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.443182 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.443322 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.443475 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.443675 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.443858 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.444019 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.444178 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.444333 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.444500 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.444664 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.444820 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.444966 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.445121 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.445292 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.445464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.445620 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.445762 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.445907 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.446050 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.446205 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.446362 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.446767 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.446912 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.447053 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.447192 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.447355 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.447497 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.447644 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.447804 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.447949 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.448092 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.448249 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.448404 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.448551 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.448753 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.448915 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.449068 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.449414 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.449554 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.449696 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.449830 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.449956 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.450098 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.450257 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.450396 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.450542 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.450687 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.450846 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.451010 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.451158 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.451300 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.451453 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.451607 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.451748 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.451915 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.452057 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.452220 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.452374 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.452518 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.452663 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.452822 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.452944 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.453078 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.453248 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.453394 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.453555 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.453719 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.453853 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.454098 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.454227 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.454371 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.454524 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.454685 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.454828 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.455003 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.455159 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.455317 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.455475 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.455619 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.455763 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.455907 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.456052 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.456196 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.456480 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.456629 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.456775 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.456927 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.457075 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.457253 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.457420 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.457575 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.457739 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.457886 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.458043 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.458190 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.458354 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.458514 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.458655 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.458809 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.458956 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.459111 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.459261 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.459389 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.459542 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.459684 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.459829 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.459988 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.460139 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.460289 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.460431 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.460577 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.460725 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.460893 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.461041 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.461187 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.461450 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.461636 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.461842 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.462027 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.462209 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.462387 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.462570 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.462755 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.463073 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.463262 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.463443 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.463626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.463825 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.464022 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.464219 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.464397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.464553 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.464714 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.464865 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.465020 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.465181 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.465371 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.465521 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.465677 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.465831 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.465983 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.466142 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.466290 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.466449 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.466587 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.466724 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.466880 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.467018 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.467165 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.467308 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.467465 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.467609 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.467767 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.467907 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.468057 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.468223 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.468367 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.468524 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.468689 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.468837 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.469000 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.469142 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.469372 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.469579 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.469750 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.469895 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.470038 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.470181 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.470323 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.470489 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.470634 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.470779 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.470923 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.471066 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.471221 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.471379 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.471536 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.471690 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.471838 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.471995 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.472154 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.472311 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.472467 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.472622 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.472773 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.472920 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.473075 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.473262 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.473425 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.473578 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.473720 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.473861 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.474018 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.474180 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.474314 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.474440 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.474568 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.474705 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.474861 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.475009 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.475175 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.475330 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.475484 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.475626 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.475779 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.475930 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.476081 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.476224 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.476365 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.476509 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.476667 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.476820 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.476966 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.477105 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.477357 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.477523 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.477523 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.477815 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.478034 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.478194 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.478342 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.478500 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.478648 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.478794 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.478941 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.479087 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.479230 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.479391 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.479541 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.479747 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.479897 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.480040 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.480183 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.480340 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.480487 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.480624 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.480764 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.480908 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.481052 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.481236 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.481383 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.481545 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.481697 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.481852 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.482013 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.482158 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.482300 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.482448 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.482592 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.482752 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.482912 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.483055 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.483203 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.483357 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.483502 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.483648 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.483809 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.483965 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.484119 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.484263 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.484465 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.484653 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.484815 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.484958 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.485097 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.485262 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.485410 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.485574 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.485728 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.485879 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.486034 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.486685 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.486835 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.486997 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.487142 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.487288 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.487435 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.487594 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.487745 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.487900 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.488107 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.488253 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.488428 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.488585 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.488731 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.488910 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.489055 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.489200 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.489392 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.489536 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.489708 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.489906 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.490056 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.490202 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.490366 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.490517 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.490694 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.490840 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.490984 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.491127 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.491271 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.491416 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.491575 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.491719 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.491920 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.492072 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.492218 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.492373 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.492636 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.492793 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.492937 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.493089 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.493402 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.493574 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.493741 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.493892 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.494037 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.494181 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.494324 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.494488 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.494700 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.494886 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.495044 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.495190 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.495347 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.495506 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.495667 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.495868 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.496021 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.496181 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.496339 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.496528 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.496686 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.496830 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.496978 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.497137 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.497364 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.497535 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.497684 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.497827 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.497971 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.498116 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.498258 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.498412 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.498569 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.498713 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.498874 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.499020 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.499178 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.499324 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.499466 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.499610 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.499610 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.499873 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.500090 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.500244 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.500244 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.500530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.500682 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.500844 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.500998 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.501143 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.501308 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.501451 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.501594 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.501761 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.501945 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.502088 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.502233 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.502388 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.502553 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.502696 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.502851 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.503003 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.503175 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.503339 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.503483 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.503624 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.503767 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.503912 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.504068 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.504212 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.504368 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.504526 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.504673 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.504891 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.505091 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.505347 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.505497 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.505642 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.505786 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.505786 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.506072 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.506224 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.506369 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.506515 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.506679 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.506839 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.506984 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.507128 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.507279 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.507436 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.507581 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.507581 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.507883 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.507883 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.508151 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.508278 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.508441 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.508600 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.508745 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.508905 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.509052 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.509229 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.509408 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.509553 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.509698 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.509698 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.509962 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.509962 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.510224 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.510224 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.510484 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.510484 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.510775 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.510951 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.511102 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.511247 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.511393 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.511552 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.511699 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.511858 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.512006 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.512152 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.512297 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.512439 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.512573 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.512733 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.512876 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.513018 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.513162 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.513362 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.513509 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.513666 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.513807 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.513951 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.514096 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.514246 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.514411 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.514557 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.514697 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.514843 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.515046 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.515231 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.515402 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.515545 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.515690 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.515848 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.515990 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.516137 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.516398 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.516546 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.516705 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.516852 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.516996 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.517141 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.517326 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.517985 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.518138 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.518302 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.518432 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.518598 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.518755 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.518938 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.519081 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.519236 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.519389 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.519550 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.519698 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.519845 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.519990 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.520136 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.520341 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.520507 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.520673 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.520828 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.520974 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.521119 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.521360 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.521521 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.521666 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.521812 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.521957 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.522101 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.522264 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.522408 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.522547 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.522689 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.522890 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.523040 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.523191 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.523326 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.523466 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.523601 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.523736 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.523866 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.524005 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.524130 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.524254 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.524380 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.524504 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.524634 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.524776 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.524905 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.525043 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.525170 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.525339 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.525476 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.525603 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.525729 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.525867 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.526005 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.526132 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.526132 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.526379 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.526507 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.526633 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.526768 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.526897 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.527038 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.527175 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.527175 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.527396 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.527519 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.527661 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.527661 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.527911 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.528040 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.528180 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.528310 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.528451 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.528583 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.528713 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.528713 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.528954 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.529084 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.529330 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.529463 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.529594 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.529722 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.529865 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.529993 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.530131 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.530260 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.530389 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.530516 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.530644 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.530786 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.530937 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.530937 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.531178 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.531306 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.531435 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.531563 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.531702 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.531829 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.531956 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.532083 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.532207 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.532348 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.532474 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.532615 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.532742 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.532868 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.533021 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.533197 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.533352 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.533473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.533615 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.533761 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.533886 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.534024 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.534155 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.534296 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.534426 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.534568 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.534693 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.534835 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.534959 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.535084 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.535222 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.535477 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.535621 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.535748 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.535875 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.536013 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.536141 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.536269 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.536410 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.536540 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.536670 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.536796 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.536927 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.537066 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.537250 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.537385 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.537530 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.537530 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.537772 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.537899 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.538045 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.538045 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.538280 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.538423 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.538545 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.538545 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.538793 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.538911 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.539020 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.539132 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.539254 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.539388 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.539516 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.539705 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.539840 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.540032 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.540171 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.540452 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.540602 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.540764 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.540909 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.541073 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.541377 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.541551 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.541716 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.541840 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.542008 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.542216 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.542383 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.542526 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.542654 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.542795 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.543026 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.543236 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.543499 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.543644 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.543879 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.544027 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.544196 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.544196 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.544471 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.544628 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.544780 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.544931 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.545075 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.545250 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.545404 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.545548 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.545691 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.545830 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.546002 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.546152 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.546316 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.546461 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.546616 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.546761 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.546941 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.547101 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.547245 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.547384 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.547531 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.547676 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.547847 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.548003 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.548180 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.548368 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.548524 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.549354 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.549513 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.549786 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.549930 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.550108 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.550258 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.550423 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.550577 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.550784 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.550934 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.551079 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.551222 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.551399 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.551564 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.551708 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.551834 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.552013 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.552171 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.552384 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.552534 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.552682 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.552895 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.553100 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.553293 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.553440 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.553584 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.553731 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.553894 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.554127 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.554277 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.554421 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.554569 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.554727 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.554957 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.554957 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.555165 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.555312 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.555469 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.555626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.555771 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.555918 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.556049 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.556178 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.556304 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.556442 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.556568 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.556732 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.556943 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.557093 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.557350 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.557516 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.557660 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.557814 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.557962 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.558108 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.558253 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.558410 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.558569 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.558792 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.558942 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.559103 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.559269 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.559426 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.559581 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.559728 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.559884 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.560028 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.560193 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.560354 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.560501 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.560663 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.560824 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.560920 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.561006 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.561163 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.561330 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.561472 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.561615 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.561756 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.561926 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.562077 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.562218 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.562361 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.562486 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.562624 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.562771 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.562914 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.563061 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.563205 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.563363 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.563522 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.563679 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.563834 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.563988 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.564129 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.564295 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.564485 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.564633 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.564800 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.564954 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.565101 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.565314 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.565476 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.565618 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.565765 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.565912 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.566058 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.566200 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.566330 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.566461 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.566591 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.566800 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.566954 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.567114 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.567263 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.567407 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.567556 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.567721 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.567868 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.568029 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.568173 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.568316 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.568472 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.568629 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.568775 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.568952 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.569112 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.569309 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.569455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.569599 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.569766 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.569916 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.570060 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.570203 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.570358 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.570502 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.570666 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.570811 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.570960 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.571106 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.571251 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.571393 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.571802 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.571949 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.572093 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.572237 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.572378 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.572536 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.572677 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.572819 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.572972 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.573116 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.573307 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.573481 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.573638 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.573783 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.573928 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.574073 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.574224 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.574397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.574541 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.574684 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.574824 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.574967 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.575110 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.575268 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.575413 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.575607 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.575758 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.575934 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.576087 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.576249 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.576375 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.576545 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.576681 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.576867 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.577024 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.577263 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.577412 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.577584 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.577769 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.577887 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.578107 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.578261 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.578429 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.578582 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.578741 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.578869 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.579052 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.579188 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.579370 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.579686 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.579852 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.580526 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.580690 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.580837 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.580984 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.581131 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.581358 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.581525 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.581673 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.581821 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.581969 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.582102 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.582248 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.582402 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.582579 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.582730 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.583032 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.583189 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.583348 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.583494 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.583665 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.583808 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.583975 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.584109 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.584368 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.584520 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.584691 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.584837 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.584996 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.585142 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.585334 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.585479 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.585621 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.585814 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.585965 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.586117 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.586273 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.586448 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.586653 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.586850 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.586999 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.587159 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.587359 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.587509 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.587655 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.587809 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.587965 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.588110 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.588256 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.588399 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.588556 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.588703 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.588870 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.589090 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.589272 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.589421 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.589565 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.589712 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.589878 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.590036 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.590186 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.590342 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.590490 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.590650 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.590795 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.590963 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.591106 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.591246 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.591392 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.591550 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.591697 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.591838 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.591981 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.592147 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.592297 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.592453 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.592609 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.592756 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.592908 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.593140 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.593347 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.593515 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.593660 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.593808 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.593968 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.594119 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.594272 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.594408 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.594595 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.594743 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.594920 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.595070 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.595227 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.595371 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.595628 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.595787 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.596026 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.596192 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.596362 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.596520 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.596669 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.596831 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.596969 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.597142 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.597348 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.597495 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.597651 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.597799 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.597952 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.598110 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.598263 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.598417 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.598564 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.598712 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.598858 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.599020 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.599273 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.599438 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.599597 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.599746 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.599891 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.600055 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.600212 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.600357 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.600514 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.600663 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.600820 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.600977 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.601120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.601315 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.601476 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.601624 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.601783 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.601924 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.602062 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.602205 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.602348 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.602506 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.602667 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.602814 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.602960 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.603163 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.603325 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.603470 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.603629 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.603780 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.603929 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.604079 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.604227 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.604389 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.604535 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.604682 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.604830 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.604977 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.605137 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.605335 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.605485 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.605643 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.605792 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.605955 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.606105 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.606263 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.606411 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.606558 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.606703 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.606849 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.606993 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.607155 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.607286 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.607442 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.607573 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.607714 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.607860 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.608024 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.608176 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.608322 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.608464 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.608602 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.608756 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.608913 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.609062 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.609359 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.609528 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.609677 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.609846 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.610002 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.610151 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.610296 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.610447 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.610599 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.610599 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.610888 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.611035 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.611698 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.611850 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.611999 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.612167 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.612315 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.612470 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.612606 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.612739 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.612895 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.613060 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.613236 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.613371 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.613536 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.613687 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.613954 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.614106 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.614262 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.614420 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.614567 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.614717 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.614885 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.615041 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.615185 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.615329 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.615470 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.615629 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.615779 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.615936 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.616087 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.616235 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.616383 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.616548 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.616697 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.616844 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.616992 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.617126 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.617302 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.617454 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.617602 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.617731 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.617881 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.618029 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.618191 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.618341 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.618487 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.618635 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.618783 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.618930 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.619090 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.619257 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.619417 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.619569 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.619721 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.619869 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.620028 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.620190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.620339 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.620489 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.620637 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.620783 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.620944 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.621093 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.621325 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.621473 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.621620 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.621785 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.621932 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.622076 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.622217 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.622370 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.622512 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.622670 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.622814 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.623012 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.623163 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.623309 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.623455 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.623614 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.623769 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.623923 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.624069 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.624224 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.624382 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.624528 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.624674 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.624819 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.624976 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.625123 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.625325 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.625473 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.625619 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.625767 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.625926 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.626086 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.626256 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.626404 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.626549 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.626696 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.626913 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.627113 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.627256 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.627415 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.627554 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.627712 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.627838 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.627994 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.628140 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.628325 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.628490 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.628638 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.628785 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.628953 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.629100 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.629280 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.629429 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.629575 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.629741 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.629891 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.630039 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.630197 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.630343 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.630489 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.630661 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.630809 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.630956 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.631116 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.631264 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.631410 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.631569 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.631722 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.631877 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.632023 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.632155 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.632295 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.632450 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.632715 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.632866 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.633008 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.633137 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.633463 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.633597 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.633739 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.633873 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.634009 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.634139 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.634286 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.634450 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.634587 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.634766 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.634907 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.635073 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.635224 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.635595 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.635739 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.635739 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.636008 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.636156 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.636302 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.636435 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.636567 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.636712 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.636844 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.636988 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.637119 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.637329 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.637467 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.637659 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.637810 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.637982 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.638129 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.638405 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.638545 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.638724 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.638860 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.639052 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.639188 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.639390 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.639541 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.639674 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.639819 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.639973 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.640113 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.640252 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.640382 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.640567 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.640723 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.640885 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.641087 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.641299 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.641432 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.641580 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.641727 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.641865 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.641995 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.642164 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.642305 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.643015 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.643265 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.643399 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.643527 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.643658 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.643787 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.643930 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.644064 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.644254 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.644396 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.644569 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.644705 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.644886 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.645024 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.645199 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.645362 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.645541 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.645679 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.645859 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.646008 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.646179 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.646318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.646489 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.646644 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.646803 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.646960 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.647109 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.647268 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.647413 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.647560 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.647738 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.647886 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.648055 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.648190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.648361 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.648468 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.648696 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.648864 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.649011 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.649184 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.649382 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.649545 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.649701 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.650012 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.650171 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.650319 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.650473 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.650666 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.650821 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.650971 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.651114 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.651268 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.651419 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.651546 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:30:43.651690 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.652127 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.652503 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.652824 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.653183 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.653551 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.653876 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.654193 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.654510 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:30:43.654743 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:30:43.808049 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO dbcounter [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Registered counter for database nova_api Aug 17 19:30:43.811738 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO dbcounter [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Registered counter for database nova_api Aug 17 19:30:43.830712 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG oslo_db.sqlalchemy.engines [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:30:43.833865 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_db.sqlalchemy.engines [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:30:43.837848 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG dbcounter [-] [106843] Writer thread running {{(pid=106843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:30:43.840905 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writer thread running {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:30:43.897436 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.context [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc(cell1) {{(pid=106843) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 19:30:43.900378 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.context [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc(cell1) {{(pid=106844) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 19:30:43.901482 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG oslo_concurrency.lockutils [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:30:43.901987 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG oslo_concurrency.lockutils [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:30:43.903632 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG oslo_concurrency.lockutils [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:30:43.904424 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG oslo_concurrency.lockutils [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:30:43.904574 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:30:43.904884 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG oslo_concurrency.lockutils [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:30:43.905019 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:30:43.906631 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:30:43.907018 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG oslo_concurrency.lockutils [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:30:43.907425 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:30:43.907889 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:30:43.909236 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO dbcounter [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Registered counter for database nova_cell0 Aug 17 19:30:43.910064 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:30:43.912246 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO dbcounter [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Registered counter for database nova_cell0 Aug 17 19:30:43.915593 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO dbcounter [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Registered counter for database nova_cell1 Aug 17 19:30:43.918681 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO dbcounter [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Registered counter for database nova_cell1 Aug 17 19:30:43.925791 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG oslo_db.sqlalchemy.engines [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:30:43.928054 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_db.sqlalchemy.engines [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:30:43.930909 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG dbcounter [-] [106843] Writer thread running {{(pid=106843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:30:43.931598 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG oslo_db.sqlalchemy.engines [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:30:43.934563 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writer thread running {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:30:43.939992 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_db.sqlalchemy.engines [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:30:44.079713 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG dbcounter [-] [106843] Writer thread running {{(pid=106843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:30:44.084094 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writer thread running {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:30:44.090348 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO dbcounter [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Registered counter for database nova_cell0 Aug 17 19:30:44.093689 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO dbcounter [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Registered counter for database nova_cell0 Aug 17 19:30:44.099658 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG oslo_db.sqlalchemy.engines [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:30:44.105609 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_db.sqlalchemy.engines [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:30:44.106245 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG dbcounter [-] [106843] Writer thread running {{(pid=106843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:30:44.110432 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writer thread running {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:30:44.463496 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: WARNING keystonemiddleware.auth_token [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 19:30:44.467164 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: WARNING keystonemiddleware.auth_token [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 19:30:44.471419 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: WARNING keystonemiddleware.auth_token [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 19:30:44.475252 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: WARNING keystonemiddleware.auth_token [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 19:30:44.822228 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: WARNING keystonemiddleware.auth_token [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 19:30:44.828241 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: WARNING keystonemiddleware.auth_token [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 19:30:44.834150 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5620b83ef9c0 pid: 106844 (default app) Aug 17 19:30:44.836154 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: WARNING keystonemiddleware.auth_token [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 19:30:44.836360 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:30:44.837600 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001851 Aug 17 19:30:44.838014 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Wed Aug 17 19:30:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:30:44.842822 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: WARNING keystonemiddleware.auth_token [None req-c8f67ede-d6a7-43aa-b985-9ba89d63ccf6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 19:30:44.848250 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5620b83ef9c0 pid: 106843 (default app) Aug 17 19:32:06.065962 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:06.066997 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001680 Aug 17 19:32:06.067592 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:32:06.080889 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG dbcounter [-] [106843] Writing DB stats nova_api:SELECT=3 {{(pid=106843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:06.083060 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG dbcounter [-] [106843] Writing DB stats nova_cell0:SELECT=3 {{(pid=106843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:06.084088 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG dbcounter [-] [106843] Writing DB stats nova_cell1:SELECT=3 {{(pid=106843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:06.084833 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG dbcounter [-] [106843] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:07.194710 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-78eb9f3f-cb47-4553-b241-bad218e9849f admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:07.250755 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-78eb9f3f-cb47-4553-b241-bad218e9849f admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.175027 Aug 17 19:32:07.251643 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1292 bytes} [Wed Aug 17 19:32:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:32:09.639345 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:09.640898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-d6aa0426-32dc-40e4-a700-e45241062122 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 17 19:32:09.641479 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:32:10.098823 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-c0016bf8-7e78-4405-a15d-8dd2855efc05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1}} {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:10.121676 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:32:10.121676 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: warnings.warn(msg) Aug 17 19:32:10.155821 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-c0016bf8-7e78-4405-a15d-8dd2855efc05 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.508341 Aug 17 19:32:10.156694 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 17 19:32:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:32:10.171379 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writing DB stats nova_api:SELECT=3 {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:10.172782 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writing DB stats nova_cell0:SELECT=3 {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:10.173970 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writing DB stats nova_cell1:SELECT=3 {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:10.174889 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:10.381646 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-3733ffe0-d521-4b3a-b25b-7c56d9348059 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:10.385944 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:32:10.385944 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: warnings.warn(msg) Aug 17 19:32:10.449102 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-3733ffe0-d521-4b3a-b25b-7c56d9348059 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283412 Aug 17 19:32:10.449714 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1336 bytes} [Wed Aug 17 19:32:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:32:12.870478 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-c0016bf8-7e78-4405-a15d-8dd2855efc05 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:12.871423 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-c0016bf8-7e78-4405-a15d-8dd2855efc05 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 17 19:32:12.871835 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:32:13.539529 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-d0ff1c18-2e76-4fbe-8089-9e972d891b7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5, "ram": 512, "swap": 0, "vcpus": 1}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:13.561022 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:32:13.561022 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: warnings.warn(msg) Aug 17 19:32:13.580865 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-d0ff1c18-2e76-4fbe-8089-9e972d891b7b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.702200 Aug 17 19:32:13.581484 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 17 19:32:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 19:32:13.594048 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-6d44a26e-127a-4ea8-b65c-4566df6b5013 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:13.596948 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:32:13.596948 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: warnings.warn(msg) Aug 17 19:32:13.630700 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-6d44a26e-127a-4ea8-b65c-4566df6b5013 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040295 Aug 17 19:32:13.631865 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1336 bytes} [Wed Aug 17 19:32:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:32:15.984323 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-d0ff1c18-2e76-4fbe-8089-9e972d891b7b admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:15.985381 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-d0ff1c18-2e76-4fbe-8089-9e972d891b7b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 17 19:32:15.985972 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:32:16.386462 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-b971f100-e977-4f53-816d-97b85af0b00f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:16.404582 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-b971f100-e977-4f53-816d-97b85af0b00f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.412647 Aug 17 19:32:16.405205 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 17 19:32:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 19:32:16.417593 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-b59f01ed-f175-4c9e-bb29-7dc114100a38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:16.442328 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-b59f01ed-f175-4c9e-bb29-7dc114100a38 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028623 Aug 17 19:32:16.442918 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1336 bytes} [Wed Aug 17 19:32:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:32:18.797770 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-b971f100-e977-4f53-816d-97b85af0b00f admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:18.798668 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-b971f100-e977-4f53-816d-97b85af0b00f admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 17 19:32:18.804469 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:32:19.250767 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-aebfde0f-608f-4aa4-beb2-85b69289d5b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "disk": 10, "rxtx_factor": 1.0}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:19.271852 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-aebfde0f-608f-4aa4-beb2-85b69289d5b8 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466205 Aug 17 19:32:19.272595 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 17 19:32:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:32:19.286089 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-db65d713-3385-4904-8d3e-d2ca25f70cc7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:19.308537 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-db65d713-3385-4904-8d3e-d2ca25f70cc7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027817 Aug 17 19:32:19.313335 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1336 bytes} [Wed Aug 17 19:32:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:32:21.675849 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-aebfde0f-608f-4aa4-beb2-85b69289d5b8 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:21.676882 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-aebfde0f-608f-4aa4-beb2-85b69289d5b8 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 17 19:32:21.677338 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:32:22.118493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-1ae982eb-591e-4041-a779-9b841ad0d07c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:22.141343 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-1ae982eb-591e-4041-a779-9b841ad0d07c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456769 Aug 17 19:32:22.142119 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 17 19:32:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:32:22.154232 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-6500d494-3a85-4760-8aac-a0bebe05067d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:22.179653 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-6500d494-3a85-4760-8aac-a0bebe05067d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029039 Aug 17 19:32:22.180278 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1336 bytes} [Wed Aug 17 19:32:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:32:25.141547 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-1ae982eb-591e-4041-a779-9b841ad0d07c admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:25.142562 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-1ae982eb-591e-4041-a779-9b841ad0d07c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002174 Aug 17 19:32:25.143007 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:32:25.590291 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-4a71bfb8-15c5-4e4e-b2c9-f6170dd9d9b9 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:25.615116 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-4a71bfb8-15c5-4e4e-b2c9-f6170dd9d9b9 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465891 Aug 17 19:32:25.615667 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1292 bytes} [Wed Aug 17 19:32:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:32:28.110132 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-1ae982eb-591e-4041-a779-9b841ad0d07c admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:28.111434 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-1ae982eb-591e-4041-a779-9b841ad0d07c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002554 Aug 17 19:32:28.111976 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:32:28.601591 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-b0f0ba57-bd47-4032-ad18-098ea9a4660c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:28.621377 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-b0f0ba57-bd47-4032-ad18-098ea9a4660c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.501047 Aug 17 19:32:28.622243 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 17 19:32:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:32:28.636019 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-3d26d418-73ba-4d0b-a6d2-f7c2b480aa99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:28.668823 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-3d26d418-73ba-4d0b-a6d2-f7c2b480aa99 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038203 Aug 17 19:32:28.669482 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1333 bytes} [Wed Aug 17 19:32:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:32:31.084553 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-b0f0ba57-bd47-4032-ad18-098ea9a4660c admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:31.086750 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-b0f0ba57-bd47-4032-ad18-098ea9a4660c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002302 Aug 17 19:32:31.087251 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:32:31.580567 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-5532e298-af00-472b-9a59-6e68674e0861 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "vcpus": 1, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:31.603379 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-5532e298-af00-472b-9a59-6e68674e0861 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.509002 Aug 17 19:32:31.605382 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 17 19:32:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:32:31.616410 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-0406218a-0441-4aee-948a-fa6aea4f713c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:31.643812 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-0406218a-0441-4aee-948a-fa6aea4f713c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031041 Aug 17 19:32:31.644509 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1333 bytes} [Wed Aug 17 19:32:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:32:34.078609 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-5532e298-af00-472b-9a59-6e68674e0861 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:34.080179 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-5532e298-af00-472b-9a59-6e68674e0861 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002118 Aug 17 19:32:34.089318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:34 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:32:34.613593 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-5523e40b-25ff-475a-8c9e-3a227ef07eb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium", "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:34.636340 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-5523e40b-25ff-475a-8c9e-3a227ef07eb9 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.548882 Aug 17 19:32:34.644478 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 17 19:32:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:32:34.649644 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-727570eb-bb7f-4f14-938c-c2dd6fcc8c75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:34.675725 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-727570eb-bb7f-4f14-938c-c2dd6fcc8c75 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030111 Aug 17 19:32:34.676872 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1333 bytes} [Wed Aug 17 19:32:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:32:37.079058 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-5523e40b-25ff-475a-8c9e-3a227ef07eb9 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:37.080723 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-5523e40b-25ff-475a-8c9e-3a227ef07eb9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002189 Aug 17 19:32:37.085492 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:37 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:32:37.538965 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-226039bf-913c-4d25-a8ef-421219cc083c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "id": "4"}} {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:37.546140 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG dbcounter [-] [106843] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:37.560845 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-226039bf-913c-4d25-a8ef-421219cc083c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473267 Aug 17 19:32:37.561423 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 17 19:32:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:32:37.573757 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-0a85e57e-69ae-4dba-acc3-12fdd8f21749 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:37.601906 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-0a85e57e-69ae-4dba-acc3-12fdd8f21749 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032084 Aug 17 19:32:37.621245 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1333 bytes} [Wed Aug 17 19:32:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:32:40.015825 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-226039bf-913c-4d25-a8ef-421219cc083c admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:40.016845 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-226039bf-913c-4d25-a8ef-421219cc083c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 17 19:32:40.017472 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:32:40.533030 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-a61352f0-4ec0-4f88-a3dd-36b0f4eba794 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:40.538853 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:40.557319 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-a61352f0-4ec0-4f88-a3dd-36b0f4eba794 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.533232 Aug 17 19:32:40.558241 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1283 bytes} [Wed Aug 17 19:32:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:32:40.574855 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-3b838c15-078a-47ce-ba91-696434e6c9ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:32:40.613320 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-3b838c15-078a-47ce-ba91-696434e6c9ae admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046364 Aug 17 19:32:40.614404 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1333 bytes} [Wed Aug 17 19:32:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:32:58.744691 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-a61352f0-4ec0-4f88-a3dd-36b0f4eba794 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:58.745794 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-a61352f0-4ec0-4f88-a3dd-36b0f4eba794 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Aug 17 19:32:58.746211 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:32:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:32:58.756904 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG dbcounter [-] [106843] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:32:59.149512 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-2405c057-6fe3-437f-be28-d794925a4954 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:32:59.168022 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-2405c057-6fe3-437f-be28-d794925a4954 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.415647 Aug 17 19:32:59.168567 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1292 bytes} [Wed Aug 17 19:32:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:33:00.227628 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-a61352f0-4ec0-4f88-a3dd-36b0f4eba794 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:00.228653 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-a61352f0-4ec0-4f88-a3dd-36b0f4eba794 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 17 19:33:00.229057 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 17 19:33:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:33:00.748653 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-61e8e057-ce19-4c91-8e29-c2d48e450772 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:00.754245 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.wsgi [None req-61e8e057-ce19-4c91-8e29-c2d48e450772 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-61e8e057-ce19-4c91-8e29-c2d48e450772 admin admin] Request method failure captured: Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Accept: application/json Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Accept-Encoding: gzip, deflate Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Connection: keep-alive Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Content-Length: 0 Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Host: 10.222.0.59 Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Openstack-Api-Version: compute 2.90 Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Openstack-System-Scope: None Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: User-Agent: python-novaclient Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Auth-Token: gAAAAABi_UJsbuOw1n4n0RPBe8ubu_iAMQvzeprv-6FFERCzG6-O9_lRi2b-GIG9u4b7KFxyOcBwqpuUVk2AyUzWtidJF_fzewkn8of7SDBfaqIUgD8TO3MsK-pOtYiwSR9QrJHx6ZCZsy72vTHl9A-IR_f4XyezlkZ-wkMD0sW-dYW40AVM81E Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Domain-Id: None Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Domain-Name: None Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Identity-Status: Confirmed Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Is-Admin-Project: True Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Project-Domain-Id: default Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Project-Domain-Name: Default Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Project-Id: 1b6bfa57344b45408392b78ab2643b3c Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Project-Name: admin Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Role: member,reader,admin Aug 17 19:33:00.757493 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Roles: member,reader,admin Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b6bfa57344b45408392b78ab2643b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6bfa57344b45408392b78ab2643b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b6bfa57344b45408392b78ab2643b3c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6bfa57344b45408392b78ab2643b3c"}]}] Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Tenant: admin Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Tenant-Id: 1b6bfa57344b45408392b78ab2643b3c Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Tenant-Name: admin Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User: admin Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User-Domain-Id: default Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User-Domain-Name: Default Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User-Id: d0e4577e8fb343208517a7b50d65f24f Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User-Name: admin Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: method: > Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: exception: Flavor 42 could not be found. Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: action_args: {'id': '42'} Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:33:00.759210 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:33:00.760318 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:00.761699 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-61e8e057-ce19-4c91-8e29-c2d48e450772 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:33:00.762981 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-61e8e057-ce19-4c91-8e29-c2d48e450772 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393130 Aug 17 19:33:00.762981 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Aug 17 19:33:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:00.770239 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-1f0edfdc-53e6-485e-a0da-3f880918fd4c admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:00.793769 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-1f0edfdc-53e6-485e-a0da-3f880918fd4c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028157 Aug 17 19:33:00.794328 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Aug 17 19:33:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:33:00.804131 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-2d806bf2-35cf-4c32-81df-b235b790e2e9 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:00.828355 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-2d806bf2-35cf-4c32-81df-b235b790e2e9 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027806 Aug 17 19:33:00.828891 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Aug 17 19:33:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:33:00.838904 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-4dce4db4-4813-4161-8a3a-b2b39cfca64e admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:00.845319 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.wsgi [None req-4dce4db4-4813-4161-8a3a-b2b39cfca64e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-4dce4db4-4813-4161-8a3a-b2b39cfca64e admin admin] Request method failure captured: Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Accept: application/json Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Accept-Encoding: gzip, deflate Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Connection: keep-alive Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Content-Length: 0 Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Host: 10.222.0.59 Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Openstack-Api-Version: compute 2.90 Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Openstack-System-Scope: None Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: User-Agent: python-novaclient Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Auth-Token: gAAAAABi_UJsbuOw1n4n0RPBe8ubu_iAMQvzeprv-6FFERCzG6-O9_lRi2b-GIG9u4b7KFxyOcBwqpuUVk2AyUzWtidJF_fzewkn8of7SDBfaqIUgD8TO3MsK-pOtYiwSR9QrJHx6ZCZsy72vTHl9A-IR_f4XyezlkZ-wkMD0sW-dYW40AVM81E Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Domain-Id: None Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Domain-Name: None Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Identity-Status: Confirmed Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Is-Admin-Project: True Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Project-Domain-Id: default Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Project-Domain-Name: Default Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Project-Id: 1b6bfa57344b45408392b78ab2643b3c Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Project-Name: admin Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Role: member,reader,admin Aug 17 19:33:00.848626 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Roles: member,reader,admin Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b6bfa57344b45408392b78ab2643b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6bfa57344b45408392b78ab2643b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b6bfa57344b45408392b78ab2643b3c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6bfa57344b45408392b78ab2643b3c"}]}] Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Tenant: admin Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Tenant-Id: 1b6bfa57344b45408392b78ab2643b3c Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Tenant-Name: admin Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User: admin Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User-Domain-Id: default Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User-Domain-Name: Default Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User-Id: d0e4577e8fb343208517a7b50d65f24f Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User-Name: admin Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: method: > Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: exception: Flavor 42 could not be found. Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: action_args: {'id': '42'} Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:33:00.850215 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:33:00.851199 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:00.852464 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-4dce4db4-4813-4161-8a3a-b2b39cfca64e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:33:00.853718 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-4dce4db4-4813-4161-8a3a-b2b39cfca64e admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015459 Aug 17 19:33:00.853718 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Aug 17 19:33:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:01.827124 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-2d806bf2-35cf-4c32-81df-b235b790e2e9 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:01.828142 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-2d806bf2-35cf-4c32-81df-b235b790e2e9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 17 19:33:01.828538 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 17 19:33:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:33:02.353845 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-e38c4078-494a-47ff-9ffc-5e14b16d6e50 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:02.359450 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.wsgi [None req-e38c4078-494a-47ff-9ffc-5e14b16d6e50 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-e38c4078-494a-47ff-9ffc-5e14b16d6e50 admin admin] Request method failure captured: Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Accept: application/json Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Accept-Encoding: gzip, deflate Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Connection: keep-alive Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Content-Length: 0 Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Host: 10.222.0.59 Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Openstack-Api-Version: compute 2.90 Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Openstack-System-Scope: None Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: User-Agent: python-novaclient Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Auth-Token: gAAAAABi_UJtyl_0w-9iyZZD6MuGkUEEfBjt5y1rlvChV8J9KRtUW-uGeUMxgGvOKQL2dBtMZEsdcPEa-zmHnlqpyQAjA6LaP0RjZ0XweC1W8R9FtMCr9kiSmQy6tYBYwcfCfP7D7LDpfsG8DXuOBF_a8JpQwQjArg40nvkX-4JTM2JwkF1HZUY Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Domain-Id: None Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Domain-Name: None Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Identity-Status: Confirmed Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Is-Admin-Project: True Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Project-Domain-Id: default Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Project-Domain-Name: Default Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Project-Id: 1b6bfa57344b45408392b78ab2643b3c Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Project-Name: admin Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Role: member,reader,admin Aug 17 19:33:02.360947 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Roles: member,reader,admin Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b6bfa57344b45408392b78ab2643b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6bfa57344b45408392b78ab2643b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b6bfa57344b45408392b78ab2643b3c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6bfa57344b45408392b78ab2643b3c"}]}] Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Tenant: admin Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Tenant-Id: 1b6bfa57344b45408392b78ab2643b3c Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Tenant-Name: admin Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User: admin Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User-Domain-Id: default Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User-Domain-Name: Default Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User-Id: d0e4577e8fb343208517a7b50d65f24f Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User-Name: admin Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: method: > Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: exception: Flavor 84 could not be found. Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: action_args: {'id': '84'} Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:33:02.362530 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:33:02.363473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:02.364726 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-e38c4078-494a-47ff-9ffc-5e14b16d6e50 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:33:02.366003 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-e38c4078-494a-47ff-9ffc-5e14b16d6e50 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.397727 Aug 17 19:33:02.366003 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Aug 17 19:33:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:02.371982 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-d9250f6b-497b-46ee-a355-cd2348566295 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:02.386825 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-d9250f6b-497b-46ee-a355-cd2348566295 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018357 Aug 17 19:33:02.387368 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Aug 17 19:33:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:33:02.397470 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-3b254f69-82c0-4f2c-837b-37c16569f107 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:02.413246 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-3b254f69-82c0-4f2c-837b-37c16569f107 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019260 Aug 17 19:33:02.413782 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Aug 17 19:33:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:33:02.423456 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-a3d7621b-47d6-4ae2-89c2-36df942bda36 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:02.428870 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.wsgi [None req-a3d7621b-47d6-4ae2-89c2-36df942bda36 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-a3d7621b-47d6-4ae2-89c2-36df942bda36 admin admin] Request method failure captured: Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Accept: application/json Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Accept-Encoding: gzip, deflate Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Connection: keep-alive Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Content-Length: 0 Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Host: 10.222.0.59 Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Openstack-Api-Version: compute 2.90 Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Openstack-System-Scope: None Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: User-Agent: python-novaclient Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Auth-Token: gAAAAABi_UJtyl_0w-9iyZZD6MuGkUEEfBjt5y1rlvChV8J9KRtUW-uGeUMxgGvOKQL2dBtMZEsdcPEa-zmHnlqpyQAjA6LaP0RjZ0XweC1W8R9FtMCr9kiSmQy6tYBYwcfCfP7D7LDpfsG8DXuOBF_a8JpQwQjArg40nvkX-4JTM2JwkF1HZUY Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Domain-Id: None Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Domain-Name: None Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Identity-Status: Confirmed Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Is-Admin-Project: True Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Project-Domain-Id: default Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Project-Domain-Name: Default Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Project-Id: 1b6bfa57344b45408392b78ab2643b3c Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Project-Name: admin Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Role: member,reader,admin Aug 17 19:33:02.430385 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Roles: member,reader,admin Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b6bfa57344b45408392b78ab2643b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6bfa57344b45408392b78ab2643b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b6bfa57344b45408392b78ab2643b3c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6bfa57344b45408392b78ab2643b3c"}]}] Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Tenant: admin Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Tenant-Id: 1b6bfa57344b45408392b78ab2643b3c Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Tenant-Name: admin Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User: admin Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User-Domain-Id: default Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User-Domain-Name: Default Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User-Id: d0e4577e8fb343208517a7b50d65f24f Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User-Name: admin Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: method: > Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: exception: Flavor 84 could not be found. Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: action_args: {'id': '84'} Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:33:02.431969 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:33:02.433085 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:02.434608 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-a3d7621b-47d6-4ae2-89c2-36df942bda36 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:33:02.435885 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-a3d7621b-47d6-4ae2-89c2-36df942bda36 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012219 Aug 17 19:33:02.435885 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Wed Aug 17 19:33:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:03.396214 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-3b254f69-82c0-4f2c-837b-37c16569f107 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:03.397243 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-3b254f69-82c0-4f2c-837b-37c16569f107 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 17 19:33:03.397641 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 17 19:33:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:33:03.917456 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-0c65ba4c-8a94-4baa-9bf1-d401b480a347 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:03.923896 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.wsgi [None req-0c65ba4c-8a94-4baa-9bf1-d401b480a347 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-0c65ba4c-8a94-4baa-9bf1-d401b480a347 admin admin] Request method failure captured: Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Accept: application/json Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Accept-Encoding: gzip, deflate Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Connection: keep-alive Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Content-Length: 0 Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Host: 10.222.0.59 Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Openstack-Api-Version: compute 2.90 Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Openstack-System-Scope: None Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: User-Agent: python-novaclient Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Auth-Token: gAAAAABi_UJv36N0VLk33Yo9WB5xw5RLBnfTZccTWr23pMlORiASWDQRt-I1AvY7kH0zG5Vta5NSXrjXf0KWYmuYviuI1_JvBcX3ldjMNbtB_MqRmSWPp7G2v6QHDro4HPD3y3ZJC2P6MKKqsvmm4v_swqgbJVTB6PfG4WfAhOCLDLGjBmqC08E Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Domain-Id: None Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Domain-Name: None Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Identity-Status: Confirmed Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Is-Admin-Project: True Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Project-Domain-Id: default Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Project-Domain-Name: Default Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Project-Id: 1b6bfa57344b45408392b78ab2643b3c Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Project-Name: admin Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Role: member,reader,admin Aug 17 19:33:03.925455 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Roles: member,reader,admin Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b6bfa57344b45408392b78ab2643b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6bfa57344b45408392b78ab2643b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b6bfa57344b45408392b78ab2643b3c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6bfa57344b45408392b78ab2643b3c"}]}] Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Tenant: admin Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Tenant-Id: 1b6bfa57344b45408392b78ab2643b3c Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-Tenant-Name: admin Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User: admin Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User-Domain-Id: default Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User-Domain-Name: Default Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User-Id: d0e4577e8fb343208517a7b50d65f24f Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: X-User-Name: admin Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: method: > Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: exception: Flavor 451 could not be found. Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: action_args: {'id': '451'} Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:33:03.927120 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:33:03.928190 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: ERROR nova.api.openstack.wsgi Aug 17 19:33:03.929595 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-0c65ba4c-8a94-4baa-9bf1-d401b480a347 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:33:03.930855 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-0c65ba4c-8a94-4baa-9bf1-d401b480a347 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390770 Aug 17 19:33:03.930855 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Aug 17 19:33:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:03.937048 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-edc80d59-be3a-492a-bbac-1951206f2675 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:03.951945 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-edc80d59-be3a-492a-bbac-1951206f2675 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019008 Aug 17 19:33:03.952492 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Aug 17 19:33:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:33:03.962042 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:03.977304 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018852 Aug 17 19:33:03.977833 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Wed Aug 17 19:33:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:33:03.987679 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-7bd22023-c83a-4009-b686-08db600e9b81 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:03.993295 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.wsgi [None req-7bd22023-c83a-4009-b686-08db600e9b81 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-7bd22023-c83a-4009-b686-08db600e9b81 admin admin] Request method failure captured: Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Accept: application/json Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Accept-Encoding: gzip, deflate Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Connection: keep-alive Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Content-Length: 0 Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Host: 10.222.0.59 Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Openstack-Api-Version: compute 2.90 Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Openstack-System-Scope: None Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: User-Agent: python-novaclient Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Auth-Token: gAAAAABi_UJv36N0VLk33Yo9WB5xw5RLBnfTZccTWr23pMlORiASWDQRt-I1AvY7kH0zG5Vta5NSXrjXf0KWYmuYviuI1_JvBcX3ldjMNbtB_MqRmSWPp7G2v6QHDro4HPD3y3ZJC2P6MKKqsvmm4v_swqgbJVTB6PfG4WfAhOCLDLGjBmqC08E Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Domain-Id: None Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Domain-Name: None Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Identity-Status: Confirmed Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Is-Admin-Project: True Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Project-Domain-Id: default Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Project-Domain-Name: Default Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Project-Id: 1b6bfa57344b45408392b78ab2643b3c Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Project-Name: admin Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Role: member,reader,admin Aug 17 19:33:03.994802 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Roles: member,reader,admin Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b6bfa57344b45408392b78ab2643b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6bfa57344b45408392b78ab2643b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b6bfa57344b45408392b78ab2643b3c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6bfa57344b45408392b78ab2643b3c"}]}] Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Tenant: admin Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Tenant-Id: 1b6bfa57344b45408392b78ab2643b3c Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-Tenant-Name: admin Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User: admin Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User-Domain-Id: default Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User-Domain-Name: Default Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User-Id: d0e4577e8fb343208517a7b50d65f24f Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: X-User-Name: admin Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: method: > Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: exception: Flavor 451 could not be found. Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: action_args: {'id': '451'} Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:33:03.996082 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:33:03.996898 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: ERROR nova.api.openstack.wsgi Aug 17 19:33:03.998397 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-7bd22023-c83a-4009-b686-08db600e9b81 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:33:04.000136 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-7bd22023-c83a-4009-b686-08db600e9b81 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012628 Aug 17 19:33:04.000136 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Aug 17 19:33:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 19:33:04.972524 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:04.973580 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 17 19:33:04.973989 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 17 19:33:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:33:05.507497 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-6cd8cdf6-4cab-43ac-b589-23103b1be5fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:33:05.527545 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-6cd8cdf6-4cab-43ac-b589-23103b1be5fc admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.405130 Aug 17 19:33:05.528094 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Wed Aug 17 19:33:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:33:06.496983 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:06.498051 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Aug 17 19:33:06.498475 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 17 19:33:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:33:07.024708 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-6e8f9e72-6b1d-41a1-b45d-bda68630b30e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:33:07.042967 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-6e8f9e72-6b1d-41a1-b45d-bda68630b30e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.403986 Aug 17 19:33:07.044030 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Wed Aug 17 19:33:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:33:08.007095 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:08.008163 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Aug 17 19:33:08.008593 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 17 19:33:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:33:08.544193 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-76777001-0375-4e4b-854f-3a5fad764bf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:33:08.565330 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-76777001-0375-4e4b-854f-3a5fad764bf7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.415291 Aug 17 19:33:08.565883 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Wed Aug 17 19:33:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:33:09.528926 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:09.530483 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 17 19:33:09.530875 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 17 19:33:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:33:10.055922 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-55273d41-38d6-4193-ace8-c9fb63b9e7a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:33:10.076301 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-55273d41-38d6-4193-ace8-c9fb63b9e7a8 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.408197 Aug 17 19:33:10.077414 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Wed Aug 17 19:33:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 19:33:11.049562 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:11.050598 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 17 19:33:11.051008 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 17 19:33:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:33:11.574956 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-da8ee81a-c8f2-4af1-a435-a7dbb0f884ec admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:33:11.595521 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-da8ee81a-c8f2-4af1-a435-a7dbb0f884ec admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.405989 Aug 17 19:33:11.596062 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Wed Aug 17 19:33:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:34:05.492981 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:34:05.493960 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-fc4d45ca-aeeb-4a35-8b2b-6a7a7e9768c0 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 17 19:34:05.494365 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 931 bytes} [Wed Aug 17 19:34:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:34:05.505407 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:05.890100 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-1fa6d981-4799-48c4-ba35-7eb866188208 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:34:05.910564 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-1fa6d981-4799-48c4-ba35-7eb866188208 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.409625 Aug 17 19:34:05.911105 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1292 bytes} [Wed Aug 17 19:34:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:34:05.932789 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG dbcounter [-] [106843] Writing DB stats nova_api:SELECT=14 {{(pid=106843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:34:05.937371 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-5a21d99a-754a-483e-b797-ad8ecba54b46 admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:34:05.944920 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-5a21d99a-754a-483e-b797-ad8ecba54b46 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013733 Aug 17 19:34:05.945475 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1283 bytes} [Wed Aug 17 19:34:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:34:05.957614 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-0f9711a1-169e-4cf2-8246-b3930f80740c admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:34:05.965248 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-0f9711a1-169e-4cf2-8246-b3930f80740c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011245 Aug 17 19:34:05.965777 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1286 bytes} [Wed Aug 17 19:34:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:34:05.977077 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-3256707b-01c3-42dd-ad55-b30ab11ecd0b admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:34:05.985066 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-3256707b-01c3-42dd-ad55-b30ab11ecd0b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011535 Aug 17 19:34:05.985629 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1286 bytes} [Wed Aug 17 19:34:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:34:05.996890 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-901b7b9e-3233-452a-9ed6-af2d59760c9a admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:34:06.005129 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-901b7b9e-3233-452a-9ed6-af2d59760c9a admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011789 Aug 17 19:34:06.005697 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1283 bytes} [Wed Aug 17 19:34:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:36:59.813013 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-3256707b-01c3-42dd-ad55-b30ab11ecd0b admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:36:59.814082 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-3256707b-01c3-42dd-ad55-b30ab11ecd0b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 17 19:36:59.814502 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 17 19:36:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:36:59.954375 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writing DB stats nova_api:SELECT=6 {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:00.113243 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-a3ae010a-6576-4f4b-a204-229c37a922b4 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:37:00.115549 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:37:00.115549 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: warnings.warn(msg) Aug 17 19:37:00.116665 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-a3ae010a-6576-4f4b-a204-229c37a922b4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:37:00.117139 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-a3ae010a-6576-4f4b-a204-229c37a922b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:37:00.117611 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-a3ae010a-6576-4f4b-a204-229c37a922b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:37:00.118318 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-a3ae010a-6576-4f4b-a204-229c37a922b4 admin admin] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:37:00.118763 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-a3ae010a-6576-4f4b-a204-229c37a922b4 admin admin] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:37:00.119178 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-a3ae010a-6576-4f4b-a204-229c37a922b4 admin admin] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:37:00.151543 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-a3ae010a-6576-4f4b-a204-229c37a922b4 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198635 Aug 17 19:37:00.152103 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Aug 17 19:36:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:37:00.987336 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-3256707b-01c3-42dd-ad55-b30ab11ecd0b admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:37:00.988364 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-3256707b-01c3-42dd-ad55-b30ab11ecd0b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 17 19:37:00.988771 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 17 19:37:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:37:01.181739 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-0fb5bdee-47f6-4a93-b3ce-b5f3c7bf5c26 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:37:01.186768 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:37:01.186768 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: warnings.warn(msg) Aug 17 19:37:01.188847 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-0fb5bdee-47f6-4a93-b3ce-b5f3c7bf5c26 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:37:01.189845 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-0fb5bdee-47f6-4a93-b3ce-b5f3c7bf5c26 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:37:01.190662 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-0fb5bdee-47f6-4a93-b3ce-b5f3c7bf5c26 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:37:01.191970 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-0fb5bdee-47f6-4a93-b3ce-b5f3c7bf5c26 admin admin] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:37:01.192817 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-0fb5bdee-47f6-4a93-b3ce-b5f3c7bf5c26 admin admin] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:37:01.193649 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-0fb5bdee-47f6-4a93-b3ce-b5f3c7bf5c26 admin admin] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:37:01.221709 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-0fb5bdee-47f6-4a93-b3ce-b5f3c7bf5c26 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.092910 Aug 17 19:37:01.222776 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Aug 17 19:37:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:37:12.458476 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-3256707b-01c3-42dd-ad55-b30ab11ecd0b admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:37:12.459531 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-3256707b-01c3-42dd-ad55-b30ab11ecd0b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 17 19:37:12.459936 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 17 19:37:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:37:12.603257 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writing DB stats nova_cell0:SELECT=4 {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:12.603977 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writing DB stats nova_cell1:SELECT=4 {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:12.604629 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG dbcounter [-] [106844] Writing DB stats nova_api:SELECT=8 {{(pid=106844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:37:12.655473 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-091407cf-5c23-4679-9b5e-36d7f3b40260 admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:37:12.657910 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:37:12.657910 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: warnings.warn(msg) Aug 17 19:37:12.659084 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-091407cf-5c23-4679-9b5e-36d7f3b40260 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:37:12.659569 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-091407cf-5c23-4679-9b5e-36d7f3b40260 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:37:12.660006 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-091407cf-5c23-4679-9b5e-36d7f3b40260 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:37:12.660729 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-091407cf-5c23-4679-9b5e-36d7f3b40260 admin admin] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:37:12.661180 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-091407cf-5c23-4679-9b5e-36d7f3b40260 admin admin] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:37:12.661629 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-091407cf-5c23-4679-9b5e-36d7f3b40260 admin admin] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:37:12.686326 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-091407cf-5c23-4679-9b5e-36d7f3b40260 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087439 Aug 17 19:37:12.686816 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Aug 17 19:37:12 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:37:13.508253 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: DEBUG nova.api.openstack.wsgi [None req-3256707b-01c3-42dd-ad55-b30ab11ecd0b admin admin] Calling method '>' {{(pid=106843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:37:13.509283 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: INFO nova.api.openstack.requestlog [None req-3256707b-01c3-42dd-ad55-b30ab11ecd0b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 17 19:37:13.509685 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: [pid: 106843|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Wed Aug 17 19:37:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:37:13.698325 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG nova.api.openstack.wsgi [None req-b7eefc28-e85d-4831-b3d1-4529762cad5e admin admin] Calling method '>' {{(pid=106844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:37:13.700963 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 19:37:13.700963 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: warnings.warn(msg) Aug 17 19:37:13.702092 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-b7eefc28-e85d-4831-b3d1-4529762cad5e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:37:13.702560 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-b7eefc28-e85d-4831-b3d1-4529762cad5e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:37:13.703017 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-b7eefc28-e85d-4831-b3d1-4529762cad5e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:37:13.703722 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-b7eefc28-e85d-4831-b3d1-4529762cad5e admin admin] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:37:13.704163 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-b7eefc28-e85d-4831-b3d1-4529762cad5e admin admin] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:37:13.704574 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: DEBUG oslo_concurrency.lockutils [None req-b7eefc28-e85d-4831-b3d1-4529762cad5e admin admin] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:37:13.726548 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: INFO nova.api.openstack.requestlog [None req-b7eefc28-e85d-4831-b3d1-4529762cad5e admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080078 Aug 17 19:37:13.727031 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: [pid: 106844|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Wed Aug 17 19:37:13 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:38:11.992649 dv-cinder-850698-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 17 19:38:11.993530 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: Wed Aug 17 19:38:11 2022 - graceful shutdown triggered... Aug 17 19:38:11.994004 dv-cinder-850698-2-iscsi devstack@n-api.service[106843]: Gracefully killing worker 1 (pid: 106843)... Aug 17 19:38:11.994439 dv-cinder-850698-2-iscsi devstack@n-api.service[106844]: Gracefully killing worker 2 (pid: 106844)... Aug 17 19:38:12.994679 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: worker 1 buried after 1 seconds Aug 17 19:38:12.995217 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: worker 2 buried after 1 seconds Aug 17 19:38:12.995217 dv-cinder-850698-2-iscsi devstack@n-api.service[106839]: goodbye to uWSGI. Aug 17 19:38:12.996277 dv-cinder-850698-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 17 19:38:12.996831 dv-cinder-850698-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 17 19:38:12.999711 dv-cinder-850698-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 19:38:13.009457 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 19:38:13.012064 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 19:38:13 2022] *** Aug 17 19:38:13.012236 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 19:38:13.012236 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 19:38:13.012236 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: nodename: dv-cinder-850698-2-iscsi Aug 17 19:38:13.012236 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: machine: x86_64 Aug 17 19:38:13.012236 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: clock source: unix Aug 17 19:38:13.012236 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: pcre jit disabled Aug 17 19:38:13.012236 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: detected number of CPU cores: 4 Aug 17 19:38:13.012236 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: current working directory: / Aug 17 19:38:13.012236 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: detected binary path: /usr/bin/uwsgi-core Aug 17 19:38:13.012236 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: your processes number limit is 47680 Aug 17 19:38:13.012945 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: your memory page size is 4096 bytes Aug 17 19:38:13.012945 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: detected max file descriptor number: 2048 Aug 17 19:38:13.012945 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: lock engine: pthread robust mutexes Aug 17 19:38:13.012945 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: thunder lock: enabled Aug 17 19:38:13.012945 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 19:38:13.012945 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 19:38:13.052460 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: Python main interpreter initialized at 0x557905f959c0 Aug 17 19:38:13.052460 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: python threads support enabled Aug 17 19:38:13.052460 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: your server socket listen backlog is limited to 100 connections Aug 17 19:38:13.052460 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: your mercy for graceful operations on workers is 90 seconds Aug 17 19:38:13.052908 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 19:38:13.052908 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: *** Operational MODE: preforking *** Aug 17 19:38:13.053173 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: *** uWSGI is running in multiple interpreter mode *** Aug 17 19:38:13.053173 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: spawned uWSGI master process (pid: 132518) Aug 17 19:38:13.053394 dv-cinder-850698-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 19:38:13.054021 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: spawned uWSGI worker 1 (pid: 132530, cores: 1) Aug 17 19:38:13.054397 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: spawned uWSGI worker 2 (pid: 132531, cores: 1) Aug 17 19:38:13.054589 dv-cinder-850698-2-iscsi devstack@n-api.service[132518]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 19:38:13.722305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 19:38:13.732544 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 19:38:14.875489 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:38:14.875489 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: from cryptography.utils import int_from_bytes Aug 17 19:38:14.876092 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:38:14.876092 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: from cryptography.utils import int_from_bytes Aug 17 19:38:14.885848 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:38:14.885848 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: from cryptography.utils import int_from_bytes Aug 17 19:38:14.886368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 19:38:14.886368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: from cryptography.utils import int_from_bytes Aug 17 19:38:17.190686 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:38:17.191587 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:38:17.192159 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:38:17.192528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:38:17.192783 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:38:17.193242 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.193569 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.193889 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.194209 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.194540 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.194851 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.195170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.195491 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.195819 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.196078 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.196392 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.196716 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850698-2-iscsi {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.197033 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.197374 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.197683 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.197998 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.198301 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.198620 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.198924 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.199420 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.199861 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.200166 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.200475 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.201072 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.201423 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.201731 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.202049 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.202350 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.202678 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.202986 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.203389 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850698-2-iscsi {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.203706 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.204010 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.204319 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.204750 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.205073 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.205408 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.205731 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.206050 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.206354 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.206690 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.207008 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.207325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.207641 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.207941 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.208253 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.210598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.210598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.210598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.210598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.210598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.210598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.210598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.210598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.212327 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.212327 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.212327 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.212327 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.212327 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.212327 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.213847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.213847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.213847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.213847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.213847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.214510 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.214510 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.214771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.214945 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.215266 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.215571 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.215886 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.216503 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.216764 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.217075 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.218109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.218109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.218109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.218464 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.218731 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.219030 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.219255 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.219561 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.219859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.220039 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 19:38:17.221109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.221261 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 19:38:17.221384 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.221384 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.221636 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 19:38:17.221782 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.221918 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 19:38:17.222053 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.222188 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 19:38:17.222316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.222444 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.223806 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.223806 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.224140 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.224288 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.224434 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.224602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.224749 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.224894 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.225045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.225200 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.225391 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.225551 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.225702 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.225864 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.226016 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.226160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.226311 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.226469 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.226615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.226766 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.226909 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.227060 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.227220 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850698-2-iscsi {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.227372 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.227526 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.227671 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.227832 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.227976 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.228177 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.228330 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.228482 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.228640 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.228786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.228936 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.229096 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.229289 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.229440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.229600 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.229600 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.229891 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.230149 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.230302 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.230464 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.230618 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.230763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.230912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.231062 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.231214 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.231368 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.231522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.231665 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.231815 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.231958 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.232100 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.232257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.232408 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.232560 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.232704 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.232853 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.233007 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.233164 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.233339 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850698-2-iscsi {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.233494 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.233646 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.233802 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.233947 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.234096 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.234239 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.234392 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.234392 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.234679 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.234824 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.234975 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.235124 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.235275 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.235437 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.235594 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.235738 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.235887 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.240708 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.240881 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.241030 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.241186 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.241354 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.241509 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.241662 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.241813 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.241972 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.242128 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.242272 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.242416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.242558 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.242707 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.242869 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.243025 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.243169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.243320 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.243470 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.243613 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.243765 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.243920 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.243920 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.244200 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.244349 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.244508 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.244659 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.244810 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.244954 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.245097 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.245257 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.245427 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.245573 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.245736 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.245880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.246033 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.246192 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.246345 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.246491 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.246636 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.246788 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.246944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.247096 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.247242 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.247393 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.247548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.247691 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.247834 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.247993 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.248154 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.248299 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.248449 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.248595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.248744 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.248900 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.249054 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.249198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.249198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.249528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.249528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.249825 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.249825 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.250097 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.250240 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.250383 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.250383 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.250670 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.250670 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.250998 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.251142 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.251292 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.251459 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.251639 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.251800 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.251952 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.252103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.252255 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.252412 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.252412 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.252412 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.252974 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.253138 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.253437 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.253609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.253762 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.253916 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.254068 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.254218 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.254376 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.254530 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.254530 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.254812 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.254956 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.255105 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.255259 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.255402 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.255555 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.255706 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.255858 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.256002 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.256154 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.256297 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.256439 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.256592 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.256744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.256888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.257045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.257188 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.257379 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.257543 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.257695 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.257853 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.258005 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.258166 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.258311 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.258311 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.258599 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.258752 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.258896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.259039 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.259182 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.259332 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.259485 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.259643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.259787 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.259930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.260072 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.260223 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.260375 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.260528 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.260679 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.260864 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.261020 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.261180 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.261378 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.261533 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.261685 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.261837 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.261981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.262134 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.262279 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.262430 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.262580 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.262731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.262874 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.263027 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.263170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.263325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.263476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.263629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.263781 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.263932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.264082 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.264226 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.264371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.264529 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.264686 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.264831 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.264973 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.265115 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.265295 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.265447 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.265600 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.265822 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.265965 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.266117 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.266268 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.266413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.266565 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.266709 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.266859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.267003 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.267154 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.267348 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.267504 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.267649 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.267800 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.267958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.268379 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.268623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.268820 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.268976 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.269127 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.269348 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.269504 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.269660 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.269660 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.269943 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.270086 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 19:38:17.270228 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.270228 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.270507 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.270659 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.270822 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.271113 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.271269 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.271422 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.271575 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.271731 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.271883 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.272029 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.272173 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.272366 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.272519 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.272663 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.272807 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.272957 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.273108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.273281 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.273431 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.273584 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.273748 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.273892 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.274038 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.274190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.274342 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.274485 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.274485 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.274763 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.274917 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.275062 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.275204 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.275346 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.275509 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.275654 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.275654 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.275945 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.276089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.276231 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.276382 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.276525 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.276677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.276820 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.276975 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.277118 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.277277 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.277439 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.277599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.277743 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.277743 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.278014 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.278165 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.278324 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.278482 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.278634 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.278778 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.278927 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.279079 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.279305 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.279462 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.279607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.279750 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.279893 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.280037 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.280194 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.280346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.280498 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.280642 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.280784 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.280965 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.281127 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.281289 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.281503 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.281659 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.281811 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.281964 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.282110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.282254 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.282396 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.282538 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.282687 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.283351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.283512 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.283797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.283970 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.284128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.284283 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.284442 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.284594 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.284738 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.284915 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.285062 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.285231 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.285394 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.285546 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.285698 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.285849 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.286010 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.286162 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.286316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.286460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.286460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.286741 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.286886 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.287158 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.287313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.287467 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.287611 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.287764 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.287915 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.288090 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.288090 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.288373 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.288373 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.288655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.288655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.288952 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.288952 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.289280 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.289447 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.289601 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.289601 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.289895 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.290051 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.290202 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.290354 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.290507 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.291319 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.291486 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.291658 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.291805 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.291958 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.292103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.292257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.292409 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.292623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.292785 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.292937 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.293088 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.293270 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.293420 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.293578 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.293731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.293882 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.294035 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.294197 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.294350 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.294532 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.294699 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.294854 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.295006 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.295157 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.295315 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.295460 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.295612 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.295800 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.295961 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.296115 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.296260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.296412 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.296557 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.296711 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.296869 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.297021 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.297165 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.297367 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.297513 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.297656 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.297813 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.297965 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.298109 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.298267 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.298447 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.299180 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.299351 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.299496 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.299639 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.299783 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.299933 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.300087 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.300240 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.300384 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.300527 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.300670 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.300813 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.300974 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.301119 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.301305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.301494 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.301640 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.301783 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.301940 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.302085 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.302228 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.302378 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.302530 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.302692 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.302851 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.303002 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.303152 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.303312 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.303469 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.303632 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.303784 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.303933 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.304083 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.304241 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.304392 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.304550 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.304707 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.304858 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.305008 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.305173 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.305416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.305580 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.305762 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.305924 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.306082 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.306242 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.306242 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.306550 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.306709 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.306860 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.307009 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.307165 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.307347 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.307506 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.307658 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.307806 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.307966 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.308116 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.308281 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.308442 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.308593 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.308750 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.308900 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.309057 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.309239 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.309510 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.309796 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.309981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.310135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.310285 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.310444 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.310595 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.310753 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.310912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.311071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.311228 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.311378 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.311570 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.311737 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.311905 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.312064 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.312222 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.312372 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.312529 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.312680 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.312838 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.312989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.313148 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.313368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.313529 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.313706 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.313857 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.313857 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.314181 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.314341 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.314491 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.314651 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.314802 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.314958 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.315116 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.315266 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.315425 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.315594 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.315759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.315916 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.316067 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.316216 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.316365 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.316523 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.316681 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.316840 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.316998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.317205 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.317396 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.317557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.317715 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.317878 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.318029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.318188 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.318361 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.318520 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.318670 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.318821 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.318971 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.319119 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.319278 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.319428 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.319585 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.319743 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.319902 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.320066 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.320217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.320367 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.320524 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.320675 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.320831 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.320991 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.321149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.321368 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.321533 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.321928 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.322094 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.322260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.322420 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.322572 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.322729 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.322887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.323048 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.323208 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.323359 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.323517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.323676 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.323828 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.323987 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.324149 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.324299 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.324448 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.324597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.324754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.324920 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.325072 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.325243 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.325410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.325562 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.325980 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.326148 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.326301 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.326469 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.326675 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.326828 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.326978 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.327143 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.327303 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.327455 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.327613 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.327772 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.327938 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.328089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.328254 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.328416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.328579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.328730 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.328894 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.329046 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.329197 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.329370 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.329532 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.329697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.329887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.330050 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.330210 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.330363 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.330514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.330675 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.330834 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.331080 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.331244 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.331406 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.331560 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.331763 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.331928 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.332087 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.332239 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.332390 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.332549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.332723 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.332875 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.333033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.333185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.333394 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.333556 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.333717 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.333876 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.334034 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.334186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.334335 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.334486 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.334688 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.334852 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.334852 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.335155 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.335305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.335468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.335622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.335771 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.335922 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.335922 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.336215 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.336374 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.336526 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.336685 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.336847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.336999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.337149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.337336 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.337497 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.337656 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.337815 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.337966 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.338116 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.338290 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.338450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.338602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.338772 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.338931 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.339090 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.339090 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.339576 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.339747 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.339912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.340063 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.340214 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.340365 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.340515 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.340783 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.341028 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.341202 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.341379 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.341542 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.341693 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.341888 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.342056 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.342218 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.342369 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.342527 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.342678 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.342838 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.342998 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.343150 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.343312 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.343463 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.343613 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.343778 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.343938 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.344091 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.344242 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.344401 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.344553 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.344718 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.344871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.345032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.345184 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.345930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.346087 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.346252 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.346405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.346563 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.346722 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.346880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.347053 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.347216 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.347367 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.347526 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.347678 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.347847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.348013 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.348165 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.348323 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.348482 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.348640 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.348794 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.349036 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.349198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.349376 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.349538 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.349690 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.349854 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.350017 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.350169 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.350328 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.350480 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.350638 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.350811 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.350971 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.351130 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.351288 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.351448 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.351607 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.351772 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.351975 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.352145 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.352297 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.352448 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.352606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.352790 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.353068 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.353327 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.353496 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.353655 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.353813 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.353977 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.354129 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.354279 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.354440 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.354592 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.354752 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.354912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.354912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.355208 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.355360 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.355519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.355680 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.355838 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.355997 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.356149 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.356323 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.356475 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.356636 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.356788 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.356939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.357089 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.357257 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.357413 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.357580 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.357733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.357883 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.358034 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.358184 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.358355 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.358516 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.358687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.358840 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.358991 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.359141 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.359305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.359464 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.359616 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.359768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.359918 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.360076 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.360236 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.360405 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.360565 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.360717 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.360871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.361087 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.361791 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.361999 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.361999 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.362301 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.362451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.362610 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.362769 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.362928 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.363099 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.363258 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.363411 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.363575 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.363733 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.363885 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.364037 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.364194 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.364359 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.364519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.364671 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.364821 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.364972 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.365132 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.365312 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.365478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.365630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.365789 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.365941 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.366092 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.366251 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.366409 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.366567 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.366724 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.366884 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.367047 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.367207 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.367358 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.367515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.367674 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.367832 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.367983 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.368147 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.368305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.368456 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.368612 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.368773 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.368978 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.369155 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.369341 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.369495 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.369655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.369806 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.369970 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.370129 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.370281 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.370431 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.370582 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.370732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.370891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.371050 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.371211 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.371363 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.371513 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.371663 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.371828 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.371987 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.372180 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.372350 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.372502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.372660 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.372825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.372985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.373144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.373343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.373495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.373661 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.373820 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.373979 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.374131 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.374288 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.374455 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.374620 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.374780 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.374946 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.375104 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.375266 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.375424 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.375590 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.375749 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.375901 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.376052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.376202 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.376352 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.376523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.376707 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.376870 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.377021 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.377181 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.377379 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.377682 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.377862 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.378025 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.378177 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.378342 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.378502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.378678 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.378831 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.378981 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.379140 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.379311 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.379470 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.379635 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.379786 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.379937 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.380096 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.380247 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.380412 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.380572 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.380723 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.380881 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.381047 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.381246 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.381405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.381627 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.381784 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.381942 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.382104 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.382299 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.382454 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.382604 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.382792 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.382956 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.383107 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.383257 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.383414 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.383567 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.383749 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.383749 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.384154 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.384308 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.384459 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.384609 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.384766 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.385048 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.385232 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.385391 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.385542 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.385705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.385866 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.386048 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.386201 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.386353 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.386504 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.386662 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.386822 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.386974 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.387132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.387291 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.387443 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.387594 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.387758 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.387918 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.388080 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.388238 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.388389 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.388545 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.388712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.388867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.389025 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.389184 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.389426 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.389580 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.389743 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.389896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.390071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.390232 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.390383 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.390547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.390706 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.390706 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.391001 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.391153 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.391304 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.391468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.391620 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.391789 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.391946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.392115 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.392352 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.392519 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.392671 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.392671 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.392964 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.393130 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.393314 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.393477 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.393629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.393779 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.393938 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.394097 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.394272 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.394425 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.394583 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.394583 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.394879 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.395029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.395192 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.395192 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.395489 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.395738 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.395893 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.396043 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.396214 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.396373 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.396525 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.396676 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.396827 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.396986 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.397149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.397532 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.397705 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.397866 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.398026 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.398192 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.398355 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.398515 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.398669 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.398826 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.399118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.399291 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.399445 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.399597 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.399748 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.399906 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.400067 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.400219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.400377 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.400539 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.400757 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.400912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.401077 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.401258 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.401416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.401578 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.401731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.401882 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.402079 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.402079 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.402424 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.402592 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.402745 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.402745 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.403061 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.403061 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.403363 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.403522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.403673 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.403838 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.403990 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.404141 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.404298 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.404449 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.404611 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.404776 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.404935 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.405087 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.405270 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.405428 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.405578 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.405742 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.405895 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.406053 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.406204 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.406355 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.406525 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.406685 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.406837 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.406989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.407140 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.407290 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.407449 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.407601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.407750 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.408443 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.408605 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.408757 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.408916 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.409089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.409259 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.409416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.409566 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.409734 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.410082 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.410256 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.410256 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.410554 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.410706 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.410866 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.411025 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.411178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.411347 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.411507 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.411667 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.411827 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.411979 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.412129 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.412288 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.412478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.412645 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.412811 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.412971 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.413123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.413338 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.413502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.413653 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.413814 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.413966 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.414123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.414284 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.414449 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.414609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.414761 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.414923 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.415074 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.415235 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.415401 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.415566 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.415719 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.415870 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.416022 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.416178 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.416337 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.416501 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.416501 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.416788 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.416947 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.417098 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.417265 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.417510 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.417671 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.417831 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.417982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.418132 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.418291 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.418450 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.418601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.418751 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.418900 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.419059 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.419219 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.419370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.419370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.419683 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.419843 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.419993 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.420152 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.420303 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.420454 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.420604 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.420755 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.420904 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.421067 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.421256 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.421413 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.421575 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.421725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.421887 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.422040 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.422197 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.422348 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.422505 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.422702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.422869 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.423022 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.423179 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.423373 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.424096 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.424262 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.424427 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.424579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.424730 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.424882 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.425033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.425193 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.425375 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.425536 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.425687 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.425687 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.426001 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.426162 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.426318 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.426468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.426618 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.426769 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.426929 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.427088 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.427239 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.427389 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.427538 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.427696 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.427866 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.428069 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.428232 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.428383 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.428533 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.428683 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.428846 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.429007 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.429160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.429346 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.429498 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.429648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.429810 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.429973 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.430123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.430274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.430431 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.430592 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.430743 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.430901 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.431053 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.431204 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.431354 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.431513 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.431671 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.431841 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.432093 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.432251 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.432401 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.432401 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.432739 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.432903 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.433062 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.433240 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.433414 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.433568 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.433718 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.433869 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.434036 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.434197 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.434363 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.434515 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.434673 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.434825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.434975 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.435133 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.435298 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.435457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.435617 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.435777 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.435938 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.436089 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.436252 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.436405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.436554 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.436705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.436858 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.437018 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.437176 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.437392 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.437552 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.437552 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.437855 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.438041 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.438202 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.438202 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.438489 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.438648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.438799 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.438970 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.439147 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.439303 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.439457 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.439607 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.439773 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.439939 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.440091 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.440242 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.440399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.440552 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.440760 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.440930 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.441096 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.441266 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.441423 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.441586 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.441751 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.441903 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.442065 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.442223 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.442375 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.442525 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.442688 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.442889 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.443048 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.443200 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.443360 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.443525 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.443685 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.443836 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.443998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.444156 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.444307 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.444468 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.444627 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.444779 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.444929 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.445079 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.445265 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.445440 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.445600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.445753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.445911 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.446073 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.446234 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.446393 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.446549 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.446708 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.446861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.447012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.447240 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.447394 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.447545 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.447696 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.447855 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.448015 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.448188 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.448347 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.448506 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.448672 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.448825 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.448984 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.449147 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.449339 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.449492 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.449643 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.449794 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.449945 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.450108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.450271 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.450423 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.450575 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.450995 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.451161 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.451314 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.451465 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.451625 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.451777 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.451930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.452091 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.452253 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.452413 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.452578 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.452749 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.453079 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.453302 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.453463 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.453615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.453615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.453903 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.454064 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.454217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.454384 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.454545 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.454741 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.454900 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.455066 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.455220 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.455372 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.455531 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.455683 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.455843 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.456004 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.456165 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.456318 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.456470 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.456622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.456785 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.456946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.457099 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.457274 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.457443 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.457657 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.457823 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.457986 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.458139 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.458291 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.458452 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.459237 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.459406 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.459560 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.459721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.459886 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.460038 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.460199 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.460351 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.460502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.460679 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.460833 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.460984 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.461148 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.461341 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.461497 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.461657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.461819 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.461980 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.462140 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.462301 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.462464 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.462618 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.462770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.462929 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.463162 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.463318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.463480 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.463633 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.463785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.463947 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.464099 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.464250 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.464411 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.464592 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.464747 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.464907 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.464907 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.465254 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.465254 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.465581 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.465581 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.465883 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.466045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.466211 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.466211 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.466500 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.466651 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.466810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.466962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.467144 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.467306 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132530) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:38:17.467468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.467468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.467468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.467468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.467468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.467468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.467468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.467468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.468614 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.468614 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.468614 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.468614 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.468614 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.468614 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.468614 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.468614 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.469906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.469906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.469906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.469906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.469906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.469906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.469906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.469906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.471643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.471643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.471643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.471643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.471643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.471643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.471643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.471643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.472786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.472786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.472786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.472786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.472786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.472786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.472786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.472786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.474089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.474089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.474089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.474089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.474089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.474089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.474089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.474089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.475249 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.475249 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.475249 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.475249 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.475249 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.475249 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.475249 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.475249 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.476398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.476398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.476398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.476398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.476398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.476398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.476398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.476398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.477719 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.477719 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.477719 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.477719 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.477719 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.477719 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.477719 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.477719 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.478883 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.478883 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.478883 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.478883 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.478883 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.478883 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.478883 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.478883 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.480072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.480072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.480072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.480072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.480072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.480072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 19:38:17.480072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132531) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 19:38:17.605280 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO dbcounter [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Registered counter for database nova_api Aug 17 19:38:17.625372 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_db.sqlalchemy.engines [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:38:17.630359 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO dbcounter [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Registered counter for database nova_api Aug 17 19:38:17.632075 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writer thread running {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:38:17.650830 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_db.sqlalchemy.engines [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:38:17.657563 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writer thread running {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:38:17.688973 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.context [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc(cell1) {{(pid=132530) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 19:38:17.693157 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:38:17.693591 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:38:17.695159 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:38:17.696061 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:38:17.696348 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:38:17.698351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:38:17.700374 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO dbcounter [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Registered counter for database nova_cell0 Aug 17 19:38:17.705501 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO dbcounter [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Registered counter for database nova_cell1 Aug 17 19:38:17.714963 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_db.sqlalchemy.engines [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:38:17.715177 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.context [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc(cell1) {{(pid=132531) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 19:38:17.715586 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_db.sqlalchemy.engines [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:38:17.719214 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:38:17.719504 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writer thread running {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:38:17.719702 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:38:17.721906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:38:17.722671 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:38:17.723114 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:38:17.725094 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:38:17.727174 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO dbcounter [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Registered counter for database nova_cell0 Aug 17 19:38:17.731363 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO dbcounter [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Registered counter for database nova_cell1 Aug 17 19:38:17.738764 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_db.sqlalchemy.engines [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:38:17.741010 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_db.sqlalchemy.engines [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:38:17.746459 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writer thread running {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:38:17.748102 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writer thread running {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:38:17.858169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writer thread running {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:38:17.868208 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO dbcounter [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Registered counter for database nova_cell0 Aug 17 19:38:17.874919 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_db.sqlalchemy.engines [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132530) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:38:17.879866 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writer thread running {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:38:17.895015 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO dbcounter [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Registered counter for database nova_cell0 Aug 17 19:38:17.901587 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_db.sqlalchemy.engines [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132531) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 19:38:17.911451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writer thread running {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 19:38:18.198044 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: WARNING keystonemiddleware.auth_token [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 19:38:18.206117 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: WARNING keystonemiddleware.auth_token [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 19:38:18.230068 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: WARNING keystonemiddleware.auth_token [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 19:38:18.237413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: WARNING keystonemiddleware.auth_token [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 19:38:18.547815 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: WARNING keystonemiddleware.auth_token [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 19:38:18.554329 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: WARNING keystonemiddleware.auth_token [None req-db451bf8-60e1-49ec-8d02-1b5314d60163 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 19:38:18.560579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557905f959c0 pid: 132530 (default app) Aug 17 19:38:18.583067 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: WARNING keystonemiddleware.auth_token [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 19:38:18.589140 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: WARNING keystonemiddleware.auth_token [None req-a712da6b-d061-40f5-bb3b-1747d2c755e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 19:38:18.595538 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557905f959c0 pid: 132531 (default app) Aug 17 19:38:52.608539 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=3 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:38:52.609565 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=3 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:38:52.610960 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=3 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:38:52.611793 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=3 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:38:53.456305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6bacfb55-d553-47af-9961-bdc4472b41c3 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Action: 'create', calling method: .version_select at 0x7f368c126280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1305942025", "metadata": {"Type": "work"}}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6bacfb55-d553-47af-9961-bdc4472b41c3 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Request method failure captured: Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 122 Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPMO8pmWhwQ8MFEEt6-OMDi4XJQgCfgTwtKH5UGpST5GbQwy0kIs59O28wo3QDz79cdAUs4753cadQrGuYSKA2QXpMp51cqRviUfLJ6vm9aenqTgNAWc4cXKBOeVm_oSvzEYYoJK5lLFae9XlPB-DfdBRka00XwZmAL-74_T0Ps0E0 Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: 26fbbe9658b1483fa3850f224cb01e4c Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:38:53.462602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/26fbbe9658b1483fa3850f224cb01e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/26fbbe9658b1483fa3850f224cb01e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_26fbbe9658b1483fa3850f224cb01e4c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/26fbbe9658b1483fa3850f224cb01e4c"}]}] Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: 26fbbe9658b1483fa3850f224cb01e4c Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-VolumesNegativeTest-1398386670-project Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 80955761dfbb4fe5b88b032804866a76 Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-VolumesNegativeTest-1398386670-project Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1305942025", "metadata": {"Type": "work"}}} Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: Aug 17 19:38:53.464839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1305942025', 'metadata': {'Type': 'work'}}}} Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise error Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi '#$%' Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:38:53.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 19:38:53.468621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 19:38:53.470346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 19:38:53.470346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.470346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6bacfb55-d553-47af-9961-bdc4472b41c3 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:38:53.470346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-6bacfb55-d553-47af-9961-bdc4472b41c3 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.866802 Aug 17 19:38:53.470346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1156 bytes} [Wed Aug 17 19:38:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 869 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 19:38:53.476687 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=3 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:38:53.477519 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=3 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:38:53.478629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=3 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:38:53.479690 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=3 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:38:53.691302 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a56ad557-8495-4fb9-9433-a39316614c0e tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Action: 'create', calling method: .version_select at 0x7f368c146dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1405608626", "metadata": {"Type": "work"}}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a56ad557-8495-4fb9-9433-a39316614c0e tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Request method failure captured: Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 120 Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPMO8pmWhwQ8MFEEt6-OMDi4XJQgCfgTwtKH5UGpST5GbQwy0kIs59O28wo3QDz79cdAUs4753cadQrGuYSKA2QXpMp51cqRviUfLJ6vm9aenqTgNAWc4cXKBOeVm_oSvzEYYoJK5lLFae9XlPB-DfdBRka00XwZmAL-74_T0Ps0E0 Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 26fbbe9658b1483fa3850f224cb01e4c Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:38:53.697318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/26fbbe9658b1483fa3850f224cb01e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/26fbbe9658b1483fa3850f224cb01e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_26fbbe9658b1483fa3850f224cb01e4c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/26fbbe9658b1483fa3850f224cb01e4c"}]}] Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 26fbbe9658b1483fa3850f224cb01e4c Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-VolumesNegativeTest-1398386670-project Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 80955761dfbb4fe5b88b032804866a76 Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-VolumesNegativeTest-1398386670-project Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1405608626", "metadata": {"Type": "work"}}} Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: Aug 17 19:38:53.699059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1405608626', 'metadata': {'Type': 'work'}}}} Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise error Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi '0' Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:38:53.700112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 19:38:53.702070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 19:38:53.704321 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 19:38:53.704321 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.704321 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a56ad557-8495-4fb9-9433-a39316614c0e tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:38:53.704321 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a56ad557-8495-4fb9-9433-a39316614c0e tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.227795 Aug 17 19:38:53.706120 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 1/2] 10.222.0.59 () {60 vars in 1156 bytes} [Wed Aug 17 19:38:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 236 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 19:38:53.713665 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a1d680cf-fcf0-4639-930d-153b32e9e029 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Action: 'create', calling method: .version_select at 0x7f368c050940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-345479883", "metadata": {"Type": "work"}}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a1d680cf-fcf0-4639-930d-153b32e9e029 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Request method failure captured: Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 118 Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPMO8pmWhwQ8MFEEt6-OMDi4XJQgCfgTwtKH5UGpST5GbQwy0kIs59O28wo3QDz79cdAUs4753cadQrGuYSKA2QXpMp51cqRviUfLJ6vm9aenqTgNAWc4cXKBOeVm_oSvzEYYoJK5lLFae9XlPB-DfdBRka00XwZmAL-74_T0Ps0E0 Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 26fbbe9658b1483fa3850f224cb01e4c Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:38:53.717313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/26fbbe9658b1483fa3850f224cb01e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/26fbbe9658b1483fa3850f224cb01e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_26fbbe9658b1483fa3850f224cb01e4c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/26fbbe9658b1483fa3850f224cb01e4c"}]}] Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 26fbbe9658b1483fa3850f224cb01e4c Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-VolumesNegativeTest-1398386670-project Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 80955761dfbb4fe5b88b032804866a76 Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-VolumesNegativeTest-1398386670-project Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-345479883", "metadata": {"Type": "work"}}} Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: Aug 17 19:38:53.720125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-345479883', 'metadata': {'Type': 'work'}}}} Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise error Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi '' Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:38:53.721198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 19:38:53.722930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 19:38:53.725271 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 19:38:53.725271 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:53.725271 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a1d680cf-fcf0-4639-930d-153b32e9e029 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:38:53.725271 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a1d680cf-fcf0-4639-930d-153b32e9e029 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011567 Aug 17 19:38:53.725271 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 2/3] 10.222.0.59 () {60 vars in 1156 bytes} [Wed Aug 17 19:38:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 19:38:53.730185 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6bbd3aa4-ac0e-41b9-a201-15a679cf9894 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Calling method '.version_select at 0x7f368c006820>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:38:53.988479 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b3dc64fb-5562-496c-b642-250f7b7ea4ae tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Action: 'create', calling method: .version_select at 0x7f368c126f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-896363162"}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:38:55.150658 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-6bbd3aa4-ac0e-41b9-a201-15a679cf9894 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] HTTP exception thrown: Volume tempest-invalid-1504219489 could not be found. Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6bbd3aa4-ac0e-41b9-a201-15a679cf9894 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Request method failure captured: Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1504219489 HTTP/1.1 Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPMO8pmWhwQ8MFEEt6-OMDi4XJQgCfgTwtKH5UGpST5GbQwy0kIs59O28wo3QDz79cdAUs4753cadQrGuYSKA2QXpMp51cqRviUfLJ6vm9aenqTgNAWc4cXKBOeVm_oSvzEYYoJK5lLFae9XlPB-DfdBRka00XwZmAL-74_T0Ps0E0 Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 26fbbe9658b1483fa3850f224cb01e4c Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:38:55.158450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/26fbbe9658b1483fa3850f224cb01e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/26fbbe9658b1483fa3850f224cb01e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_26fbbe9658b1483fa3850f224cb01e4c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/26fbbe9658b1483fa3850f224cb01e4c"}]}] Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 26fbbe9658b1483fa3850f224cb01e4c Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-VolumesNegativeTest-1398386670-project Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 80955761dfbb4fe5b88b032804866a76 Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-VolumesNegativeTest-1398386670-project Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Volume tempest-invalid-1504219489 could not be found. Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': 'tempest-invalid-1504219489'} Aug 17 19:38:55.159814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1504219489 could not be found. (HTTP 404) (Request-ID: req-1b82f508-b84d-4147-9265-6fe648a1cbfc) Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:55.160589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 19:38:55.161781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1504219489 could not be found. Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:38:55.166641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1504219489 could not be found. Aug 17 19:38:55.169640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.169640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:55.169640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.169640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:55.169640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:38:55.169640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:38:55.169640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:38:55.169640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:38:55.169640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1504219489 could not be found. Aug 17 19:38:55.169640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.173052 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6bbd3aa4-ac0e-41b9-a201-15a679cf9894 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Returning 404 to user: Volume tempest-invalid-1504219489 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:38:55.174892 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6bbd3aa4-ac0e-41b9-a201-15a679cf9894 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1504219489" status: 404 len: 99 microversion: 2.1 time: 1.449468 Aug 17 19:38:55.176235 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 3/4] 10.222.0.59 () {58 vars in 1218 bytes} [Wed Aug 17 19:38:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1504219489 => generated 99 bytes in 1451 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 17 19:38:55.201162 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-cf9bae59-b3a4-42b0-b0b0-b361c639c695 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016149 Aug 17 19:38:55.204570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 4/5] 10.222.0.59 () {58 vars in 1140 bytes} [Wed Aug 17 19:38:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 19:38:55.224017 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-68a11e8c-3994-492c-a4fb-8bab7978fe05 tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011697 Aug 17 19:38:55.225868 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 5/6] 10.222.0.59 () {58 vars in 1137 bytes} [Wed Aug 17 19:38:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 19:38:55.240419 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6676f0d6-6b4b-492d-9a7e-58a2f7da8e8f tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Calling method '.version_select at 0x7f368bf010d0>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:38:55.287873 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-6676f0d6-6b4b-492d-9a7e-58a2f7da8e8f tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] HTTP exception thrown: Volume c66391b3-0dca-4fc0-bfdf-f6376c66bc1f could not be found. Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6676f0d6-6b4b-492d-9a7e-58a2f7da8e8f tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Request method failure captured: Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: DELETE /compute/v2.1/os-volumes/c66391b3-0dca-4fc0-bfdf-f6376c66bc1f HTTP/1.1 Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPMO8pmWhwQ8MFEEt6-OMDi4XJQgCfgTwtKH5UGpST5GbQwy0kIs59O28wo3QDz79cdAUs4753cadQrGuYSKA2QXpMp51cqRviUfLJ6vm9aenqTgNAWc4cXKBOeVm_oSvzEYYoJK5lLFae9XlPB-DfdBRka00XwZmAL-74_T0Ps0E0 Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 26fbbe9658b1483fa3850f224cb01e4c Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:38:55.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/26fbbe9658b1483fa3850f224cb01e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/26fbbe9658b1483fa3850f224cb01e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_26fbbe9658b1483fa3850f224cb01e4c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/26fbbe9658b1483fa3850f224cb01e4c"}]}] Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 26fbbe9658b1483fa3850f224cb01e4c Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-VolumesNegativeTest-1398386670-project Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 80955761dfbb4fe5b88b032804866a76 Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-VolumesNegativeTest-1398386670-project Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Volume c66391b3-0dca-4fc0-bfdf-f6376c66bc1f could not be found. Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': 'c66391b3-0dca-4fc0-bfdf-f6376c66bc1f'} Aug 17 19:38:55.291508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c66391b3-0dca-4fc0-bfdf-f6376c66bc1f could not be found. (HTTP 404) (Request-ID: req-d1e0cb05-cc4c-4bb5-8636-fd355e509670) Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:55.292371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 19:38:55.293885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c66391b3-0dca-4fc0-bfdf-f6376c66bc1f could not be found. Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 19:38:55.295331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:38:55.296712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c66391b3-0dca-4fc0-bfdf-f6376c66bc1f could not be found. Aug 17 19:38:55.296712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.296712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:55.296712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.296712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:55.296712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:38:55.296712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:38:55.296712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:38:55.296712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:38:55.296712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c66391b3-0dca-4fc0-bfdf-f6376c66bc1f could not be found. Aug 17 19:38:55.296712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.296712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6676f0d6-6b4b-492d-9a7e-58a2f7da8e8f tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Returning 404 to user: Volume c66391b3-0dca-4fc0-bfdf-f6376c66bc1f could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:38:55.298169 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6676f0d6-6b4b-492d-9a7e-58a2f7da8e8f tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/c66391b3-0dca-4fc0-bfdf-f6376c66bc1f" status: 404 len: 109 microversion: 2.1 time: 0.065257 Aug 17 19:38:55.298887 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 6/7] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 17 19:38:55 2022] DELETE /compute/v2.1/os-volumes/c66391b3-0dca-4fc0-bfdf-f6376c66bc1f => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:38:55.314381 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4885a4b6-a664-4000-9880-dc9fdbf601da tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Calling method '.version_select at 0x7f368bf68d30>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:38:55.371544 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-4885a4b6-a664-4000-9880-dc9fdbf601da tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] HTTP exception thrown: Volume e527b79e-adaf-4c65-8142-b72597301896 could not be found. Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4885a4b6-a664-4000-9880-dc9fdbf601da tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Request method failure captured: Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/os-volumes/e527b79e-adaf-4c65-8142-b72597301896 HTTP/1.1 Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPMO8pmWhwQ8MFEEt6-OMDi4XJQgCfgTwtKH5UGpST5GbQwy0kIs59O28wo3QDz79cdAUs4753cadQrGuYSKA2QXpMp51cqRviUfLJ6vm9aenqTgNAWc4cXKBOeVm_oSvzEYYoJK5lLFae9XlPB-DfdBRka00XwZmAL-74_T0Ps0E0 Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 26fbbe9658b1483fa3850f224cb01e4c Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:38:55.376522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/26fbbe9658b1483fa3850f224cb01e4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/26fbbe9658b1483fa3850f224cb01e4c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_26fbbe9658b1483fa3850f224cb01e4c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/26fbbe9658b1483fa3850f224cb01e4c"}]}] Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 26fbbe9658b1483fa3850f224cb01e4c Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-VolumesNegativeTest-1398386670 Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-VolumesNegativeTest-1398386670-project Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 80955761dfbb4fe5b88b032804866a76 Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-VolumesNegativeTest-1398386670-project Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Volume e527b79e-adaf-4c65-8142-b72597301896 could not be found. Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': 'e527b79e-adaf-4c65-8142-b72597301896'} Aug 17 19:38:55.378189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e527b79e-adaf-4c65-8142-b72597301896 could not be found. (HTTP 404) (Request-ID: req-1a0da034-5738-40a1-80cd-03700f590bcc) Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:55.379071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 19:38:55.381183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e527b79e-adaf-4c65-8142-b72597301896 could not be found. Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 19:38:55.383515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e527b79e-adaf-4c65-8142-b72597301896 could not be found. Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e527b79e-adaf-4c65-8142-b72597301896 could not be found. Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4885a4b6-a664-4000-9880-dc9fdbf601da tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] Returning 404 to user: Volume e527b79e-adaf-4c65-8142-b72597301896 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-4885a4b6-a664-4000-9880-dc9fdbf601da tempest-VolumesNegativeTest-1398386670 tempest-VolumesNegativeTest-1398386670-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/e527b79e-adaf-4c65-8142-b72597301896" status: 404 len: 109 microversion: 2.1 time: 0.073667 Aug 17 19:38:55.385596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 7/8] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:38:55 2022] GET /compute/v2.1/os-volumes/e527b79e-adaf-4c65-8142-b72597301896 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 19:38:55.852220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b3dc64fb-5562-496c-b642-250f7b7ea4ae tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.230841 Aug 17 19:38:55.852899 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 2/9] 10.222.0.59 () {60 vars in 1155 bytes} [Wed Aug 17 19:38:53 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2234 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 19:38:55.875115 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d565f335-101a-48bb-89e5-007d9902cbaa tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf01a60>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:38:55.967904 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d565f335-101a-48bb-89e5-007d9902cbaa tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9" status: 200 len: 344 microversion: 2.1 time: 0.101171 Aug 17 19:38:55.969126 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 8/10] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:38:55 2022] GET /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 => generated 344 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:38:56.987736 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-04d9e06d-4362-4cb9-aa43-d6919098933b tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf30700>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:38:57.075327 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-04d9e06d-4362-4cb9-aa43-d6919098933b tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9" status: 200 len: 345 microversion: 2.1 time: 0.096973 Aug 17 19:38:57.076765 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 3/11] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:38:56 2022] GET /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:38:57.090611 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-36b5802c-060a-44ec-9258-dfe7e55f1402 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Action: 'create', calling method: .version_select at 0x7f368bf120d0>, body: {"snapshot": {"volume_id": "abfe8be5-d1d2-45cb-8b7c-750c05e52bc9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1704345170"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:38:57.708777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-36b5802c-060a-44ec-9258-dfe7e55f1402 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.622936 Aug 17 19:38:57.709689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 9/12] 10.222.0.59 () {60 vars in 1162 bytes} [Wed Aug 17 19:38:57 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:38:57.720289 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1dd9fb70-bfb8-4dac-925d-4c191287cb21 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf30dc0>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:38:57.817431 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1dd9fb70-bfb8-4dac-925d-4c191287cb21 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19" status: 200 len: 287 microversion: 2.1 time: 0.100606 Aug 17 19:38:57.825524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 4/13] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 17 19:38:57 2022] GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19 => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:38:57.830661 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8db500c4-477b-493e-9229-ff63b660afa8 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf68e50>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:38:57.885750 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8db500c4-477b-493e-9229-ff63b660afa8 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.059601 Aug 17 19:38:57.886832 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 10/14] 10.222.0.59 () {58 vars in 1140 bytes} [Wed Aug 17 19:38:57 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:38:57.901745 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e3f2d183-111f-420a-9042-0e200c47c4ab tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf30af0>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:38:57.945775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e3f2d183-111f-420a-9042-0e200c47c4ab tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19" status: 200 len: 287 microversion: 2.1 time: 0.050159 Aug 17 19:38:57.946689 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 5/15] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 17 19:38:57 2022] GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:38:58.959634 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-28e1df54-978d-4a02-bf61-c3574674808f tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf12ca0>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:38:59.018936 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-28e1df54-978d-4a02-bf61-c3574674808f tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19" status: 200 len: 287 microversion: 2.1 time: 0.064232 Aug 17 19:38:59.021282 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 11/16] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 17 19:38:58 2022] GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:00.034898 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c3bd1a6c-866d-40f4-b510-debbd6b43501 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf304c0>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:00.097129 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c3bd1a6c-866d-40f4-b510-debbd6b43501 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19" status: 200 len: 287 microversion: 2.1 time: 0.069064 Aug 17 19:39:00.098033 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 6/17] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 17 19:39:00 2022] GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:01.110774 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-34de0715-b875-4484-b04b-6216eee73527 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf1b430>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:01.189722 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-34de0715-b875-4484-b04b-6216eee73527 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19" status: 200 len: 288 microversion: 2.1 time: 0.083971 Aug 17 19:39:01.190678 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 12/18] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 17 19:39:01 2022] GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19 => generated 288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:01.207875 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-da1ba7f8-ea14-47c2-8e7b-ff38deca59d4 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf495e0>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:01.728315 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-da1ba7f8-ea14-47c2-8e7b-ff38deca59d4 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19" status: 202 len: 0 microversion: 2.1 time: 0.530472 Aug 17 19:39:01.732075 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 7/19] 10.222.0.59 () {58 vars in 1254 bytes} [Wed Aug 17 19:39:01 2022] DELETE /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19 => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:39:01.738676 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-811314e9-3865-470c-9b2c-144cdd9c29dd tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf128b0>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:01.820276 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-811314e9-3865-470c-9b2c-144cdd9c29dd tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19" status: 200 len: 287 microversion: 2.1 time: 0.085353 Aug 17 19:39:01.820887 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 13/20] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 17 19:39:01 2022] GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:02.833895 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-31cdade7-5369-44ce-a143-fcdfc5b8341d tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf30700>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:02.883846 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-31cdade7-5369-44ce-a143-fcdfc5b8341d tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] HTTP exception thrown: Snapshot 0806924a-f511-42da-889e-ad1812495d19 could not be found. Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-31cdade7-5369-44ce-a143-fcdfc5b8341d tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Request method failure captured: Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19 HTTP/1.1 Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPNMEuuu3trfzRvEdG8L7qo5q4wlGRbNSVtNhUOHKlje9aovubGT4PUe5tzftS-rdqjNl3YmmaTTPjHZgFcx_a3y3BIBhRZmlq1duJfa0XBBaXZEodIVO2F11UCHgKEDuF1S40afnaswrjKJS7VGjgjGpKIqTRPD_envUUVL-hSHnU Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: 40e0b95a8f3a4fc49b4da6bce66e6287 Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941783062 Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:39:02.888445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40e0b95a8f3a4fc49b4da6bce66e6287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40e0b95a8f3a4fc49b4da6bce66e6287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40e0b95a8f3a4fc49b4da6bce66e6287", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40e0b95a8f3a4fc49b4da6bce66e6287"}]}] Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941783062 Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: 40e0b95a8f3a4fc49b4da6bce66e6287 Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941783062 Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-VolumesSnapshotsTestJSON-941783062-project Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 1aaeb0c1bfc04384a3159b110471e29d Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941783062-project Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Snapshot 0806924a-f511-42da-889e-ad1812495d19 could not be found. Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '0806924a-f511-42da-889e-ad1812495d19'} Aug 17 19:39:02.889808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0806924a-f511-42da-889e-ad1812495d19 could not be found. (HTTP 404) (Request-ID: req-2cde0038-268c-4696-8060-e12221d2b5cc) Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:02.890712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 19:39:02.891730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0806924a-f511-42da-889e-ad1812495d19 could not be found. Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 17 19:39:02.892841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:39:02.894103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0806924a-f511-42da-889e-ad1812495d19 could not be found. Aug 17 19:39:02.894103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:02.894103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:02.894103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:02.894103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:02.894103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:39:02.894103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:39:02.894103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:39:02.894103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:39:02.894103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0806924a-f511-42da-889e-ad1812495d19 could not be found. Aug 17 19:39:02.894103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:02.898002 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-31cdade7-5369-44ce-a143-fcdfc5b8341d tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Returning 404 to user: Snapshot 0806924a-f511-42da-889e-ad1812495d19 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:39:02.899435 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-31cdade7-5369-44ce-a143-fcdfc5b8341d tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19" status: 404 len: 111 microversion: 2.1 time: 0.070281 Aug 17 19:39:02.902437 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 8/21] 10.222.0.59 () {58 vars in 1251 bytes} [Wed Aug 17 19:39:02 2022] GET /compute/v2.1/os-snapshots/0806924a-f511-42da-889e-ad1812495d19 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:39:02.915772 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-817a686a-f1e9-4e68-a8cd-87192d538899 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf12280>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:03.120224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-817a686a-f1e9-4e68-a8cd-87192d538899 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9" status: 202 len: 0 microversion: 2.1 time: 0.209836 Aug 17 19:39:03.120993 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 14/22] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 17 19:39:02 2022] DELETE /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:39:03.151754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ef54229d-f2c6-424f-8eac-e8ef368156e0 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368c06f040>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:03.308202 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ef54229d-f2c6-424f-8eac-e8ef368156e0 tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9" status: 200 len: 344 microversion: 2.1 time: 0.182850 Aug 17 19:39:03.309321 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 9/23] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:39:03 2022] GET /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:04.322957 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-992ae3e8-49ad-4b4c-b659-00beb63e07bc tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf68e50>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:04.367014 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-992ae3e8-49ad-4b4c-b659-00beb63e07bc tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] HTTP exception thrown: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-992ae3e8-49ad-4b4c-b659-00beb63e07bc tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Request method failure captured: Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 HTTP/1.1 Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPNMEuuu3trfzRvEdG8L7qo5q4wlGRbNSVtNhUOHKlje9aovubGT4PUe5tzftS-rdqjNl3YmmaTTPjHZgFcx_a3y3BIBhRZmlq1duJfa0XBBaXZEodIVO2F11UCHgKEDuF1S40afnaswrjKJS7VGjgjGpKIqTRPD_envUUVL-hSHnU Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 40e0b95a8f3a4fc49b4da6bce66e6287 Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941783062 Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:39:04.369238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40e0b95a8f3a4fc49b4da6bce66e6287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40e0b95a8f3a4fc49b4da6bce66e6287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40e0b95a8f3a4fc49b4da6bce66e6287", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40e0b95a8f3a4fc49b4da6bce66e6287"}]}] Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941783062 Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 40e0b95a8f3a4fc49b4da6bce66e6287 Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941783062 Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-VolumesSnapshotsTestJSON-941783062-project Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 1aaeb0c1bfc04384a3159b110471e29d Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941783062-project Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': 'abfe8be5-d1d2-45cb-8b7c-750c05e52bc9'} Aug 17 19:39:04.370225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. (HTTP 404) (Request-ID: req-822e0107-eb1d-4fbe-912b-f9747c00f102) Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:04.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 19:39:04.371847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 19:39:04.378475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-992ae3e8-49ad-4b4c-b659-00beb63e07bc tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Returning 404 to user: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-992ae3e8-49ad-4b4c-b659-00beb63e07bc tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9" status: 404 len: 109 microversion: 2.1 time: 0.053034 Aug 17 19:39:04.379898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 15/24] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:39:04 2022] GET /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:39:04.383503 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-237010a8-9149-4def-ab2c-ee297ff99ecf tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf4c040>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:04.448720 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-237010a8-9149-4def-ab2c-ee297ff99ecf tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] HTTP exception thrown: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-237010a8-9149-4def-ab2c-ee297ff99ecf tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Request method failure captured: Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: DELETE /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 HTTP/1.1 Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPNMEuuu3trfzRvEdG8L7qo5q4wlGRbNSVtNhUOHKlje9aovubGT4PUe5tzftS-rdqjNl3YmmaTTPjHZgFcx_a3y3BIBhRZmlq1duJfa0XBBaXZEodIVO2F11UCHgKEDuF1S40afnaswrjKJS7VGjgjGpKIqTRPD_envUUVL-hSHnU Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: 40e0b95a8f3a4fc49b4da6bce66e6287 Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941783062 Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:39:04.451648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40e0b95a8f3a4fc49b4da6bce66e6287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40e0b95a8f3a4fc49b4da6bce66e6287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40e0b95a8f3a4fc49b4da6bce66e6287", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40e0b95a8f3a4fc49b4da6bce66e6287"}]}] Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941783062 Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: 40e0b95a8f3a4fc49b4da6bce66e6287 Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941783062 Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-VolumesSnapshotsTestJSON-941783062-project Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 1aaeb0c1bfc04384a3159b110471e29d Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941783062-project Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': 'abfe8be5-d1d2-45cb-8b7c-750c05e52bc9'} Aug 17 19:39:04.452767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. (HTTP 404) (Request-ID: req-15d85816-3537-48c6-8568-5de6fcbb6f57) Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:04.453652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 19:39:04.454615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 19:39:04.456718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-237010a8-9149-4def-ab2c-ee297ff99ecf tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Returning 404 to user: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:39:04.458622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-237010a8-9149-4def-ab2c-ee297ff99ecf tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9" status: 404 len: 109 microversion: 2.1 time: 0.075634 Aug 17 19:39:04.460277 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 10/25] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 17 19:39:04 2022] DELETE /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:39:04.463392 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f9cc71c0-8930-4349-bb2c-04d363e4948f tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Calling method '.version_select at 0x7f368bf68c10>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:04.535763 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-f9cc71c0-8930-4349-bb2c-04d363e4948f tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] HTTP exception thrown: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f9cc71c0-8930-4349-bb2c-04d363e4948f tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Request method failure captured: Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 HTTP/1.1 Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPNMEuuu3trfzRvEdG8L7qo5q4wlGRbNSVtNhUOHKlje9aovubGT4PUe5tzftS-rdqjNl3YmmaTTPjHZgFcx_a3y3BIBhRZmlq1duJfa0XBBaXZEodIVO2F11UCHgKEDuF1S40afnaswrjKJS7VGjgjGpKIqTRPD_envUUVL-hSHnU Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 40e0b95a8f3a4fc49b4da6bce66e6287 Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-941783062 Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:39:04.538474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/40e0b95a8f3a4fc49b4da6bce66e6287"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40e0b95a8f3a4fc49b4da6bce66e6287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_40e0b95a8f3a4fc49b4da6bce66e6287", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/40e0b95a8f3a4fc49b4da6bce66e6287"}]}] Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-VolumesSnapshotsTestJSON-941783062 Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 40e0b95a8f3a4fc49b4da6bce66e6287 Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-941783062 Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-VolumesSnapshotsTestJSON-941783062-project Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 1aaeb0c1bfc04384a3159b110471e29d Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-VolumesSnapshotsTestJSON-941783062-project Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': 'abfe8be5-d1d2-45cb-8b7c-750c05e52bc9'} Aug 17 19:39:04.539846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. (HTTP 404) (Request-ID: req-f5d04a9a-ce6b-4829-9e5c-61ec13b350dd) Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:04.540597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 19:39:04.541872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 19:39:04.542930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f9cc71c0-8930-4349-bb2c-04d363e4948f tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] Returning 404 to user: Volume abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f9cc71c0-8930-4349-bb2c-04d363e4948f tempest-VolumesSnapshotsTestJSON-941783062 tempest-VolumesSnapshotsTestJSON-941783062-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9" status: 404 len: 109 microversion: 2.1 time: 0.080834 Aug 17 19:39:04.544466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 16/26] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:39:04 2022] GET /compute/v2.1/os-volumes/abfe8be5-d1d2-45cb-8b7c-750c05e52bc9 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:39:09.896278 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1916062428", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:10.142030 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.network.neutron [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] validate_networks() for [('e5255586-eadf-4699-a0a6-becc090592e0', None, None, None, None, None)] {{(pid=132530) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:39:11.168063 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8207e7fc-dfdd-4334-96cb-240ba8a1703d tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] Action: 'create', calling method: .version_select at 0x7f368bf68670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1130060153", "metadata": {"Type": "work"}}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:11.962684 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8207e7fc-dfdd-4334-96cb-240ba8a1703d tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.130692 Aug 17 19:39:11.963465 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 17/27] 10.222.0.59 () {60 vars in 1156 bytes} [Wed Aug 17 19:39:10 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1132 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 19:39:12.108061 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Flavor limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:39:12.108536 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Image limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:39:12.109140 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Flavor pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:39:12.110526 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Image pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:39:12.110526 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:39:12.147169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:12.148920 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:12.151779 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:12.155275 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:12.157132 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:12.157853 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:12.237112 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Getting quotas for project 25f3817d99d84da2b797215d23de887f. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:39:12.260545 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Getting quotas for user 608237a0c2704cd3bda98f3724db2528 and project 25f3817d99d84da2b797215d23de887f. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:39:12.297780 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Going to run 1 instances... {{(pid=132530) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:39:12.304802 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132530) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:39:12.496417 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e9533797-aedc-473f-8217-ee4117357507 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.515977 Aug 17 19:39:12.500526 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 11/28] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:39:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 3521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:39:12.704666 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-07b317bf-9b38-4a11-8e68-18a1e77598a6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Action: 'create', calling method: .version_select at 0x7f368bf12a60>, body: {"keypair": {"name": "tempest-keypair-946537379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4rxxP0bVeLBSGgnifQBe5zZ1Q3LEBMdsm0pE1hPZcT2RYq7XeA23Uvb5eQNPWvK0qq7ovuz5VkmuB63b6mgr7ihn+KHE7Z0qDjR8ikT+DdecPqatv5AY7QRbttrBLwqA=="}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:12.841790 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-07b317bf-9b38-4a11-8e68-18a1e77598a6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Getting quotas for project 5e6832c3bb274bb1bdfd27ca3869f8cd. Resources: {'key_pairs'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:39:12.878651 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-7b11186b-1786-4619-9109-5c443a0e861e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Action: 'create', calling method: .version_select at 0x7f368be17dc0>, body: {"keypair": {"name": "tempest-keypair-1729813087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmfnpa6adEgwTKxiqtsFfrO0E3d1WlAL3JQPo8jw4aSVY2cRLFtgybUdr3cyG5wns3HHD6OTlfAILYWp8k14feiwBwVEOedf5JQmd6cTnKZW0+Zq9J8W0NcANk2TtMNOQ=="}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:12.880106 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-07b317bf-9b38-4a11-8e68-18a1e77598a6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Getting quotas for user a569e6174a7c4a1887bd292e3c06df89 and project 5e6832c3bb274bb1bdfd27ca3869f8cd. Resources: {'key_pairs'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:39:12.919036 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-7b11186b-1786-4619-9109-5c443a0e861e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Getting quotas for project d8e17f7523b4492394df211a01a4193c. Resources: {'key_pairs'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:39:12.956009 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-7b11186b-1786-4619-9109-5c443a0e861e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Getting quotas for user f698e4a2f6074756adc52f6b6b9ff9fd and project d8e17f7523b4492394df211a01a4193c. Resources: {'key_pairs'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:39:13.021057 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-07b317bf-9b38-4a11-8e68-18a1e77598a6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.056266 Aug 17 19:39:13.021881 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 18/29] 10.222.0.59 () {62 vars in 1200 bytes} [Wed Aug 17 19:39:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1058 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 19:39:13.069873 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-7b11186b-1786-4619-9109-5c443a0e861e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.557816 Aug 17 19:39:13.072023 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 12/30] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 17 19:39:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:13.077319 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1b8384d2-28f0-48cb-a0ff-ff1916902382 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] Calling method '.version_select at 0x7f368adb6700>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:13.257168 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1b8384d2-28f0-48cb-a0ff-ff1916902382 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296" status: 200 len: 353 microversion: 2.1 time: 0.183848 Aug 17 19:39:13.257790 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 13/31] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:39:13 2022] GET /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296 => generated 353 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:13.262364 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3bf7067e-c42f-41ee-a8b9-5d58aa8cea25 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:13.263663 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3bf7067e-c42f-41ee-a8b9-5d58aa8cea25 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:13.383275 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1924844115", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "networks": [{"uuid": "b841ea97-b954-4339-9d37-a395f8715cac"}]}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:13.565294 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3bf7067e-c42f-41ee-a8b9-5d58aa8cea25 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:13.576892 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.network.neutron [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] validate_networks() for [('b841ea97-b954-4339-9d37-a395f8715cac', None, None, None, None, None)] {{(pid=132531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:39:13.606160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3bf7067e-c42f-41ee-a8b9-5d58aa8cea25 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1222 microversion: 2.1 time: 0.347297 Aug 17 19:39:13.612143 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 14/32] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:13 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1222 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:13.844842 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1178636108", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:13.970344 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.network.neutron [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] validate_networks() for [('e5255586-eadf-4699-a0a6-becc090592e0', None, None, None, None, None)] {{(pid=132530) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:39:16.201780 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Flavor limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:39:16.203445 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Image limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:39:16.203940 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Flavor pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:39:16.204493 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Image pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:39:16.204914 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:39:16.227306 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:16.227790 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:16.228227 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:16.228952 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:16.229435 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:16.229868 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:16.347728 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Getting quotas for project adff2535a66d443baa9ddc4b5bde9ef2. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:39:16.360483 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Getting quotas for user bda1e1b7cfb44577bf7063f2e09f6791 and project adff2535a66d443baa9ddc4b5bde9ef2. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:39:16.393835 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Going to run 1 instances... {{(pid=132531) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:39:16.409201 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:39:16.701539 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f55ab2d9-c613-41d7-8e79-f15d91d082bc tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.678125 Aug 17 19:39:16.702196 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 19/33] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:39:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:39:16.723154 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a36884f3-766d-4044-bd57-e3b4f880e883 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] Calling method '.version_select at 0x7f368b5b18b0>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:16.854583 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a36884f3-766d-4044-bd57-e3b4f880e883 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296" status: 200 len: 354 microversion: 2.1 time: 0.135999 Aug 17 19:39:16.855178 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 20/34] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:39:16 2022] GET /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296 => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:16.867727 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9fd823ab-62c8-48ec-8694-4304e93f403b tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:16.868572 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9fd823ab-62c8-48ec-8694-4304e93f403b tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:16.928715 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Flavor limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:39:16.929811 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Image limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:39:16.930303 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Flavor pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:39:16.930731 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Image pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:39:16.931143 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:39:16.953658 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:16.954398 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:16.955236 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:16.956288 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:16.958922 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:16.959596 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:17.005711 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Getting quotas for project 25f3817d99d84da2b797215d23de887f. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:39:17.026914 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Getting quotas for user 608237a0c2704cd3bda98f3724db2528 and project 25f3817d99d84da2b797215d23de887f. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:39:17.072069 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Going to run 1 instances... {{(pid=132530) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:39:17.075217 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132530) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:39:17.204896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ff97f97d-c94d-4e9e-be6a-6e74444b67e0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.364506 Aug 17 19:39:17.209268 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 15/35] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:39:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 19:39:17.220528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8b867e1a-cab7-472a-94b7-a9b56dbdcca9 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] Calling method '.version_select at 0x7f368bf4c8b0>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:17.224922 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9fd823ab-62c8-48ec-8694-4304e93f403b tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:17.255281 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9fd823ab-62c8-48ec-8694-4304e93f403b tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1215 microversion: 2.1 time: 0.387909 Aug 17 19:39:17.255940 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 21/36] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:16 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1215 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:17.273353 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f19656e7-6acf-4cd5-9861-c04eee6646ae tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:17.279439 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f19656e7-6acf-4cd5-9861-c04eee6646ae tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:17.368966 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8b867e1a-cab7-472a-94b7-a9b56dbdcca9 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296" status: 200 len: 354 microversion: 2.1 time: 0.158378 Aug 17 19:39:17.369900 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 16/37] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:39:17 2022] GET /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296 => generated 354 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:17.393130 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5165356f-6db0-456a-943f-f935ceb1a28c tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] Calling method '.version_select at 0x7f368a5784c0>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:17.512834 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5165356f-6db0-456a-943f-f935ceb1a28c tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296" status: 202 len: 0 microversion: 2.1 time: 0.124043 Aug 17 19:39:17.513763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 17/38] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 17 19:39:17 2022] DELETE /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:39:17.522591 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d06f8bc9-2190-4351-b57e-22c6a3591042 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] Calling method '.version_select at 0x7f368bf4c820>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:17.710201 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d06f8bc9-2190-4351-b57e-22c6a3591042 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296" status: 200 len: 353 microversion: 2.1 time: 0.191588 Aug 17 19:39:17.711265 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 18/39] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:39:17 2022] GET /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296 => generated 353 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:39:17.793630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f19656e7-6acf-4cd5-9861-c04eee6646ae tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:17.806794 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f19656e7-6acf-4cd5-9861-c04eee6646ae tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1222 microversion: 2.1 time: 0.545244 Aug 17 19:39:17.809342 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 22/40] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:17 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1222 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:18.276831 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-0bd6acb4-959e-49c0-af03-7c87d87f2b0a tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:18.278933 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-0bd6acb4-959e-49c0-af03-7c87d87f2b0a tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:18.725563 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ea248509-9e12-4fe4-9ea5-983c5b6b6e74 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] Calling method '.version_select at 0x7f368a575430>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:18.754270 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0bd6acb4-959e-49c0-af03-7c87d87f2b0a tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:18.775243 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-0bd6acb4-959e-49c0-af03-7c87d87f2b0a tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1215 microversion: 2.1 time: 0.499226 Aug 17 19:39:18.778378 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 19/41] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:18 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1215 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:18.836899 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-578e87ad-e73e-4f3c-8c20-df1cc250e91e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:18.837772 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-578e87ad-e73e-4f3c-8c20-df1cc250e91e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:18.847326 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-ea248509-9e12-4fe4-9ea5-983c5b6b6e74 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] HTTP exception thrown: Volume 55b4568f-1f9c-447a-939b-92115cef1296 could not be found. Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ea248509-9e12-4fe4-9ea5-983c5b6b6e74 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] Request method failure captured: Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296 HTTP/1.1 Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPeX2QxC6U2FUqDbUt9EKTgngOIFSfKRy8U2LAY_lNn9WpHkDNRA3Hhbx0PpOgoTiXZsMfI_4rcGr46UIXf_BypafvQN4ZQ3YnL8sdmYh9SMAbYcoKA4uj2tw7o5YKA1GPPdAbJrwXsjUYQuZFEfUO4pUobdkHa0sckqG7C7iJyl2M Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 70b374f93ceb484dafb306f681a7a76e Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-VolumesGetTestJSON-304830091 Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:39:18.850248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/70b374f93ceb484dafb306f681a7a76e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/70b374f93ceb484dafb306f681a7a76e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_70b374f93ceb484dafb306f681a7a76e", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/70b374f93ceb484dafb306f681a7a76e"}]}] Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-VolumesGetTestJSON-304830091 Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 70b374f93ceb484dafb306f681a7a76e Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-VolumesGetTestJSON-304830091 Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-VolumesGetTestJSON-304830091-project Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 1cba145cda2c4fc28aa0d9ef93b55b3f Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-VolumesGetTestJSON-304830091-project Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Volume 55b4568f-1f9c-447a-939b-92115cef1296 could not be found. Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '55b4568f-1f9c-447a-939b-92115cef1296'} Aug 17 19:39:18.851399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55b4568f-1f9c-447a-939b-92115cef1296 could not be found. (HTTP 404) (Request-ID: req-817f47ca-c80e-4a6d-92f7-dde05dbfc635) Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:18.852110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 19:39:18.853033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55b4568f-1f9c-447a-939b-92115cef1296 could not be found. Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 19:39:18.853998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55b4568f-1f9c-447a-939b-92115cef1296 could not be found. Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55b4568f-1f9c-447a-939b-92115cef1296 could not be found. Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ea248509-9e12-4fe4-9ea5-983c5b6b6e74 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] Returning 404 to user: Volume 55b4568f-1f9c-447a-939b-92115cef1296 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ea248509-9e12-4fe4-9ea5-983c5b6b6e74 tempest-VolumesGetTestJSON-304830091 tempest-VolumesGetTestJSON-304830091-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296" status: 404 len: 109 microversion: 2.1 time: 0.131199 Aug 17 19:39:18.854939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 23/42] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:39:18 2022] GET /compute/v2.1/os-volumes/55b4568f-1f9c-447a-939b-92115cef1296 => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:39:18.860785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-578e87ad-e73e-4f3c-8c20-df1cc250e91e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:18.861326 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-578e87ad-e73e-4f3c-8c20-df1cc250e91e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:18.861775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-578e87ad-e73e-4f3c-8c20-df1cc250e91e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:18.862492 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-578e87ad-e73e-4f3c-8c20-df1cc250e91e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:18.867426 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-578e87ad-e73e-4f3c-8c20-df1cc250e91e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:18.867941 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-578e87ad-e73e-4f3c-8c20-df1cc250e91e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:19.158629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1919337107", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efd33d7e-e98e-4b70-ba3d-e5bc9d6e97e0"}], "security_groups": [{"name": "tempest-securitygroup--1542271844"}], "key_name": "tempest-keypair-1729813087", "user_data": "}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:19.708992 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-578e87ad-e73e-4f3c-8c20-df1cc250e91e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:19.731595 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-578e87ad-e73e-4f3c-8c20-df1cc250e91e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1218 microversion: 2.1 time: 0.900057 Aug 17 19:39:19.753602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 20/43] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:18 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1218 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:39:19.801610 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-682fc4da-6050-4852-aef9-ccbfed299e53 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:19.802171 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-682fc4da-6050-4852-aef9-ccbfed299e53 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:19.809376 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-682fc4da-6050-4852-aef9-ccbfed299e53 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:19.809882 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-682fc4da-6050-4852-aef9-ccbfed299e53 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:19.810319 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-682fc4da-6050-4852-aef9-ccbfed299e53 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:19.820470 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-682fc4da-6050-4852-aef9-ccbfed299e53 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:19.820974 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-682fc4da-6050-4852-aef9-ccbfed299e53 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:19.821454 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-682fc4da-6050-4852-aef9-ccbfed299e53 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:19.888527 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.network.neutron [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] validate_networks() for [('efd33d7e-e98e-4b70-ba3d-e5bc9d6e97e0', None, None, None, None, None)] {{(pid=132531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:39:20.784676 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-682fc4da-6050-4852-aef9-ccbfed299e53 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:20.810602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-682fc4da-6050-4852-aef9-ccbfed299e53 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1211 microversion: 2.1 time: 1.006579 Aug 17 19:39:20.814979 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 21/44] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:19 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1211 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:39:20.842625 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-173eb609-1cd9-43a9-8c86-55b8e183936b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:20.850802 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-173eb609-1cd9-43a9-8c86-55b8e183936b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:20.880970 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-173eb609-1cd9-43a9-8c86-55b8e183936b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:20.881790 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-173eb609-1cd9-43a9-8c86-55b8e183936b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:20.884154 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-173eb609-1cd9-43a9-8c86-55b8e183936b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:20.888653 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-173eb609-1cd9-43a9-8c86-55b8e183936b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:20.891379 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-173eb609-1cd9-43a9-8c86-55b8e183936b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:20.892106 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-173eb609-1cd9-43a9-8c86-55b8e183936b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:21.165518 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-173eb609-1cd9-43a9-8c86-55b8e183936b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:21.181040 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-173eb609-1cd9-43a9-8c86-55b8e183936b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1292 microversion: 2.1 time: 0.363241 Aug 17 19:39:21.193794 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 22/45] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:20 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1292 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:21.239500 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-224324437", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53e2c10b-2873-4690-b5af-dafebda8a7df"}], "security_groups": [{"name": "tempest-securitygroup--1217548370"}], "key_name": "tempest-keypair-946537379", "user_data": "}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:22.586541 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.network.neutron [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] validate_networks() for [('53e2c10b-2873-4690-b5af-dafebda8a7df', None, None, None, None, None)] {{(pid=132530) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:39:23.363956 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Flavor limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:39:23.365319 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Image limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:39:23.366375 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Flavor pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:39:23.370857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Image pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:39:23.371647 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:39:23.423085 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:23.424563 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:23.427104 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:23.428261 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:23.429890 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:23.431282 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:23.507764 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Getting quotas for project d8e17f7523b4492394df211a01a4193c. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:39:23.523110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Getting quotas for user f698e4a2f6074756adc52f6b6b9ff9fd and project d8e17f7523b4492394df211a01a4193c. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:39:23.574336 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Going to run 1 instances... {{(pid=132531) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:39:23.583248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:39:23.734442 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-750591ee-e647-4b9d-9cd9-db87c04ba593 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.583174 Aug 17 19:39:23.735460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:39:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 4585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:39:23.754101 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5a280567-1865-4ce9-86fd-c5ab4c71c0e9 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:23.755751 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5a280567-1865-4ce9-86fd-c5ab4c71c0e9 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:23.771663 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5a280567-1865-4ce9-86fd-c5ab4c71c0e9 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:23.772348 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5a280567-1865-4ce9-86fd-c5ab4c71c0e9 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:23.772985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5a280567-1865-4ce9-86fd-c5ab4c71c0e9 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:23.773893 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5a280567-1865-4ce9-86fd-c5ab4c71c0e9 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:23.774753 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5a280567-1865-4ce9-86fd-c5ab4c71c0e9 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:23.775327 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5a280567-1865-4ce9-86fd-c5ab4c71c0e9 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:24.464528 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5a280567-1865-4ce9-86fd-c5ab4c71c0e9 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:24.494641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5a280567-1865-4ce9-86fd-c5ab4c71c0e9 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1273 microversion: 2.1 time: 0.756882 Aug 17 19:39:24.495760 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 25/47] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:23 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1273 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:24.508313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-2adbb577-dcce-4da5-b30a-c99ee113a652 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:24.518389 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-2adbb577-dcce-4da5-b30a-c99ee113a652 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:24.544020 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2adbb577-dcce-4da5-b30a-c99ee113a652 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:24.546677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2adbb577-dcce-4da5-b30a-c99ee113a652 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:24.548074 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2adbb577-dcce-4da5-b30a-c99ee113a652 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:24.550779 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2adbb577-dcce-4da5-b30a-c99ee113a652 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:24.551462 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2adbb577-dcce-4da5-b30a-c99ee113a652 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:24.553406 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2adbb577-dcce-4da5-b30a-c99ee113a652 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:25.278615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Flavor limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:39:25.284540 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Image limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:39:25.287483 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Flavor pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:39:25.289176 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Image pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:39:25.290750 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:39:25.341244 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:25.342111 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:25.356928 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:25.373126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:25.376444 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:25.377460 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:25.442815 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Getting quotas for project 5e6832c3bb274bb1bdfd27ca3869f8cd. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:39:25.447502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Getting quotas for user a569e6174a7c4a1887bd292e3c06df89 and project 5e6832c3bb274bb1bdfd27ca3869f8cd. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:39:25.463106 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Going to run 1 instances... {{(pid=132530) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:39:25.473727 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2adbb577-dcce-4da5-b30a-c99ee113a652 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:25.483039 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132530) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:39:25.490482 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-2adbb577-dcce-4da5-b30a-c99ee113a652 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.983000 Aug 17 19:39:25.491154 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 26/48] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:24 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:25.496180 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5b15b6ef-a051-48db-87e1-21019ad2d34f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:25.507231 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5b15b6ef-a051-48db-87e1-21019ad2d34f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:25.532536 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5b15b6ef-a051-48db-87e1-21019ad2d34f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:25.533037 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5b15b6ef-a051-48db-87e1-21019ad2d34f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:25.533510 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5b15b6ef-a051-48db-87e1-21019ad2d34f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:25.534230 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5b15b6ef-a051-48db-87e1-21019ad2d34f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:25.534690 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5b15b6ef-a051-48db-87e1-21019ad2d34f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:25.535118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5b15b6ef-a051-48db-87e1-21019ad2d34f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:25.595792 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2d15bc24-c4c0-438a-b7e0-e09bf06c213e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.397907 Aug 17 19:39:25.597418 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 23/49] 10.222.0.59 () {62 vars in 1188 bytes} [Wed Aug 17 19:39:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 4402 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 19:39:25.613203 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-9574deaa-0ae0-4d07-8f6b-38258db11402 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:25.617269 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9574deaa-0ae0-4d07-8f6b-38258db11402 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:25.662709 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9574deaa-0ae0-4d07-8f6b-38258db11402 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:25.663456 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9574deaa-0ae0-4d07-8f6b-38258db11402 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:25.664156 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9574deaa-0ae0-4d07-8f6b-38258db11402 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:25.665169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9574deaa-0ae0-4d07-8f6b-38258db11402 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:25.666288 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9574deaa-0ae0-4d07-8f6b-38258db11402 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:25.669919 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9574deaa-0ae0-4d07-8f6b-38258db11402 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:25.915939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5b15b6ef-a051-48db-87e1-21019ad2d34f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:25.926226 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5b15b6ef-a051-48db-87e1-21019ad2d34f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1290 microversion: 2.1 time: 0.433650 Aug 17 19:39:25.929825 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 27/50] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:25 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1290 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:25.948731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ceb9e03f-ead1-4b8f-8c89-fed25afda6f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:25.949411 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ceb9e03f-ead1-4b8f-8c89-fed25afda6f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:27.207908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-ceb9e03f-ead1-4b8f-8c89-fed25afda6f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:27.218712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-ceb9e03f-ead1-4b8f-8c89-fed25afda6f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:27.220626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-ceb9e03f-ead1-4b8f-8c89-fed25afda6f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:27.221978 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ceb9e03f-ead1-4b8f-8c89-fed25afda6f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1280 microversion: 2.20 time: 1.290535 Aug 17 19:39:27.223417 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 28/51] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:25 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1280 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:27.231232 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-481553da-2ffe-4c44-b557-1dc316f6f582 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:27.232100 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-481553da-2ffe-4c44-b557-1dc316f6f582 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:27.244695 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-481553da-2ffe-4c44-b557-1dc316f6f582 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:27.245431 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-481553da-2ffe-4c44-b557-1dc316f6f582 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:27.246184 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-481553da-2ffe-4c44-b557-1dc316f6f582 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:27.247084 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-481553da-2ffe-4c44-b557-1dc316f6f582 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:27.247726 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-481553da-2ffe-4c44-b557-1dc316f6f582 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:27.248646 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-481553da-2ffe-4c44-b557-1dc316f6f582 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:27.793937 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9574deaa-0ae0-4d07-8f6b-38258db11402 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:27.812631 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-9574deaa-0ae0-4d07-8f6b-38258db11402 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 2.213407 Aug 17 19:39:27.856738 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 24/52] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:25 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:27.877807 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3657ae40-63f4-43c5-9236-b15bf24b351f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:27.887733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3657ae40-63f4-43c5-9236-b15bf24b351f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:27.903806 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3657ae40-63f4-43c5-9236-b15bf24b351f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:27.904306 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3657ae40-63f4-43c5-9236-b15bf24b351f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:27.904755 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3657ae40-63f4-43c5-9236-b15bf24b351f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:27.905531 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3657ae40-63f4-43c5-9236-b15bf24b351f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:27.906010 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3657ae40-63f4-43c5-9236-b15bf24b351f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:27.932039 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3657ae40-63f4-43c5-9236-b15bf24b351f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:28.414681 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3657ae40-63f4-43c5-9236-b15bf24b351f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:28.432535 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3657ae40-63f4-43c5-9236-b15bf24b351f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1296 microversion: 2.1 time: 0.572113 Aug 17 19:39:28.434159 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 25/53] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:27 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1296 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:28.479619 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-481553da-2ffe-4c44-b557-1dc316f6f582 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:28.491468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-481553da-2ffe-4c44-b557-1dc316f6f582 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 1.266668 Aug 17 19:39:28.492064 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 29/54] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:27 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:28.514205 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-855fe6e2-49db-472d-b3f8-4bfd67ad041d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:28.520172 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-855fe6e2-49db-472d-b3f8-4bfd67ad041d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:28.542669 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-855fe6e2-49db-472d-b3f8-4bfd67ad041d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:28.549267 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-855fe6e2-49db-472d-b3f8-4bfd67ad041d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:28.550070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-855fe6e2-49db-472d-b3f8-4bfd67ad041d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:28.553506 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-855fe6e2-49db-472d-b3f8-4bfd67ad041d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:28.556245 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-855fe6e2-49db-472d-b3f8-4bfd67ad041d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:28.562066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-855fe6e2-49db-472d-b3f8-4bfd67ad041d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:28.767576 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-8ff74ae0-9fee-478b-a18f-efd1b9d87d8c req-9771a17c-bbc2-4021-b3d8-7aa1e7d07e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "001bd590-d203-4670-aef3-300aae8d4c4f", "tag": "00265e2e-29dc-406a-a2b2-cd2bb162da12"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:28.805560 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-8ff74ae0-9fee-478b-a18f-efd1b9d87d8c req-9771a17c-bbc2-4021-b3d8-7aa1e7d07e7d service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:28.809157 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-8ff74ae0-9fee-478b-a18f-efd1b9d87d8c req-9771a17c-bbc2-4021-b3d8-7aa1e7d07e7d service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:28.809157 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-8ff74ae0-9fee-478b-a18f-efd1b9d87d8c req-9771a17c-bbc2-4021-b3d8-7aa1e7d07e7d service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:28.898195 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-8ff74ae0-9fee-478b-a18f-efd1b9d87d8c req-9771a17c-bbc2-4021-b3d8-7aa1e7d07e7d service nova] Creating event network-changed:00265e2e-29dc-406a-a2b2-cd2bb162da12 for instance 001bd590-d203-4670-aef3-300aae8d4c4f on hv-cinder-85069 Aug 17 19:39:28.900753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-8ff74ae0-9fee-478b-a18f-efd1b9d87d8c req-9771a17c-bbc2-4021-b3d8-7aa1e7d07e7d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132530) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 19:39:28.901191 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-8ff74ae0-9fee-478b-a18f-efd1b9d87d8c req-9771a17c-bbc2-4021-b3d8-7aa1e7d07e7d service nova] Acquired lock "compute-rpcapi-router" {{(pid=132530) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 19:39:28.904661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-05d27fb6-3ff8-4894-8b49-00e44302a442 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:28.906421 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-05d27fb6-3ff8-4894-8b49-00e44302a442 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:28.907011 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-05d27fb6-3ff8-4894-8b49-00e44302a442 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:28.910810 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-05d27fb6-3ff8-4894-8b49-00e44302a442 None None] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:28.911310 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-05d27fb6-3ff8-4894-8b49-00e44302a442 None None] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:28.911746 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-05d27fb6-3ff8-4894-8b49-00e44302a442 None None] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:28.955699 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.compute.rpcapi [None req-05d27fb6-3ff8-4894-8b49-00e44302a442 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 19:39:28.957026 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-05d27fb6-3ff8-4894-8b49-00e44302a442 None None] Releasing lock "compute-rpcapi-router" {{(pid=132530) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 19:39:28.961538 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-855fe6e2-49db-472d-b3f8-4bfd67ad041d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:28.982091 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-855fe6e2-49db-472d-b3f8-4bfd67ad041d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:28.983744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-855fe6e2-49db-472d-b3f8-4bfd67ad041d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:28.984905 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-855fe6e2-49db-472d-b3f8-4bfd67ad041d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1338 microversion: 2.20 time: 0.487001 Aug 17 19:39:28.985502 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 30/55] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:28 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1338 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:29.001618 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-05d27fb6-3ff8-4894-8b49-00e44302a442 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.565668 Aug 17 19:39:29.003200 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 26/56] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:29.027751 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-18b36963-59f9-4f54-82fc-3085a3193af1 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:29.033239 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-18b36963-59f9-4f54-82fc-3085a3193af1 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:29.067776 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-18b36963-59f9-4f54-82fc-3085a3193af1 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:29.069754 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-18b36963-59f9-4f54-82fc-3085a3193af1 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:29.072484 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-18b36963-59f9-4f54-82fc-3085a3193af1 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:29.073882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-18b36963-59f9-4f54-82fc-3085a3193af1 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:29.076057 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-18b36963-59f9-4f54-82fc-3085a3193af1 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:29.079971 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-18b36963-59f9-4f54-82fc-3085a3193af1 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:29.457388 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-37e708c3-4ba2-47d8-9487-ffde6249757f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:29.458162 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-37e708c3-4ba2-47d8-9487-ffde6249757f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:29.475864 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-37e708c3-4ba2-47d8-9487-ffde6249757f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:29.477472 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-37e708c3-4ba2-47d8-9487-ffde6249757f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:29.477943 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-37e708c3-4ba2-47d8-9487-ffde6249757f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:29.479916 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-37e708c3-4ba2-47d8-9487-ffde6249757f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:29.480392 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-37e708c3-4ba2-47d8-9487-ffde6249757f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:29.482761 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-37e708c3-4ba2-47d8-9487-ffde6249757f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:29.663341 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-18b36963-59f9-4f54-82fc-3085a3193af1 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:29.679242 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-18b36963-59f9-4f54-82fc-3085a3193af1 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.676121 Aug 17 19:39:29.683981 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 31/57] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:29 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:29.694208 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9caa086a-8328-4ff0-a9d7-dbb771ab3cac tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:29.697503 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9caa086a-8328-4ff0-a9d7-dbb771ab3cac tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:29.712030 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9caa086a-8328-4ff0-a9d7-dbb771ab3cac tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:29.714197 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9caa086a-8328-4ff0-a9d7-dbb771ab3cac tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:29.715494 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9caa086a-8328-4ff0-a9d7-dbb771ab3cac tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:29.720553 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9caa086a-8328-4ff0-a9d7-dbb771ab3cac tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:29.721610 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9caa086a-8328-4ff0-a9d7-dbb771ab3cac tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:29.722345 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9caa086a-8328-4ff0-a9d7-dbb771ab3cac tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:29.732654 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-37e708c3-4ba2-47d8-9487-ffde6249757f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:29.743048 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-37e708c3-4ba2-47d8-9487-ffde6249757f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1296 microversion: 2.1 time: 0.290845 Aug 17 19:39:29.752230 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 27/58] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:29 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1296 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:39:30.014370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-0bdc5018-307f-4e88-aa6f-5595a3af6ce0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:30.015667 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-0bdc5018-307f-4e88-aa6f-5595a3af6ce0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:30.052655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0bdc5018-307f-4e88-aa6f-5595a3af6ce0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:30.055165 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0bdc5018-307f-4e88-aa6f-5595a3af6ce0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:30.056329 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0bdc5018-307f-4e88-aa6f-5595a3af6ce0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:30.063883 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0bdc5018-307f-4e88-aa6f-5595a3af6ce0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:30.066642 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0bdc5018-307f-4e88-aa6f-5595a3af6ce0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:30.068593 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0bdc5018-307f-4e88-aa6f-5595a3af6ce0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:30.273635 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0bdc5018-307f-4e88-aa6f-5595a3af6ce0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:30.299262 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0bdc5018-307f-4e88-aa6f-5595a3af6ce0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:30.301487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0bdc5018-307f-4e88-aa6f-5595a3af6ce0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:30.307533 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-0bdc5018-307f-4e88-aa6f-5595a3af6ce0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1338 microversion: 2.20 time: 0.296892 Aug 17 19:39:30.310322 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 28/59] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:30 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1338 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:30.401293 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9caa086a-8328-4ff0-a9d7-dbb771ab3cac tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:30.414647 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9caa086a-8328-4ff0-a9d7-dbb771ab3cac tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.726416 Aug 17 19:39:30.415414 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 32/60] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:29 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:30.705522 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4a06d78d-13ae-4394-8d7f-b239387c7915 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:30.706154 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4a06d78d-13ae-4394-8d7f-b239387c7915 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:30.719502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4a06d78d-13ae-4394-8d7f-b239387c7915 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:30.721367 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4a06d78d-13ae-4394-8d7f-b239387c7915 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:30.721873 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4a06d78d-13ae-4394-8d7f-b239387c7915 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:30.722604 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4a06d78d-13ae-4394-8d7f-b239387c7915 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:30.723063 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4a06d78d-13ae-4394-8d7f-b239387c7915 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:30.729742 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4a06d78d-13ae-4394-8d7f-b239387c7915 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:30.772215 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8c79e4e1-d596-48b2-8c5b-635e15077a57 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:30.772825 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-8c79e4e1-d596-48b2-8c5b-635e15077a57 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:30.789994 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8c79e4e1-d596-48b2-8c5b-635e15077a57 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:30.790489 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8c79e4e1-d596-48b2-8c5b-635e15077a57 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:30.790929 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8c79e4e1-d596-48b2-8c5b-635e15077a57 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:30.800344 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8c79e4e1-d596-48b2-8c5b-635e15077a57 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:30.803296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8c79e4e1-d596-48b2-8c5b-635e15077a57 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:30.803751 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8c79e4e1-d596-48b2-8c5b-635e15077a57 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:31.122671 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8c79e4e1-d596-48b2-8c5b-635e15077a57 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:31.135855 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8c79e4e1-d596-48b2-8c5b-635e15077a57 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1296 microversion: 2.1 time: 0.367548 Aug 17 19:39:31.140575 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 33/61] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:30 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1296 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:31.303047 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-4e7f762c-6da5-42f7-8981-76b35acf1132 req-be99ca75-893b-4663-94ee-8bc64a3daf41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55783dca-99fe-42bc-9e65-2c65038d0902", "tag": "31d9c9ee-a38e-4efd-a8af-b6989873b33d"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:31.336085 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-4e7f762c-6da5-42f7-8981-76b35acf1132 req-be99ca75-893b-4663-94ee-8bc64a3daf41 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:31.336790 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-4e7f762c-6da5-42f7-8981-76b35acf1132 req-be99ca75-893b-4663-94ee-8bc64a3daf41 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:31.337642 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-4e7f762c-6da5-42f7-8981-76b35acf1132 req-be99ca75-893b-4663-94ee-8bc64a3daf41 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:31.379510 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-4e7f762c-6da5-42f7-8981-76b35acf1132 req-be99ca75-893b-4663-94ee-8bc64a3daf41 service nova] Creating event network-changed:31d9c9ee-a38e-4efd-a8af-b6989873b33d for instance 55783dca-99fe-42bc-9e65-2c65038d0902 on hv-cinder-85069 Aug 17 19:39:31.380180 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-4e7f762c-6da5-42f7-8981-76b35acf1132 req-be99ca75-893b-4663-94ee-8bc64a3daf41 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 19:39:31.380801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-4e7f762c-6da5-42f7-8981-76b35acf1132 req-be99ca75-893b-4663-94ee-8bc64a3daf41 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 19:39:31.385285 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5682aaf8-2f8e-4abf-9744-920c3dedec5d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:31.386036 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5682aaf8-2f8e-4abf-9744-920c3dedec5d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:31.387923 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5682aaf8-2f8e-4abf-9744-920c3dedec5d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:31.388985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5682aaf8-2f8e-4abf-9744-920c3dedec5d None None] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:31.396631 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5682aaf8-2f8e-4abf-9744-920c3dedec5d None None] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:31.397471 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5682aaf8-2f8e-4abf-9744-920c3dedec5d None None] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:31.416773 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.compute.rpcapi [None req-5682aaf8-2f8e-4abf-9744-920c3dedec5d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 19:39:31.422016 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5682aaf8-2f8e-4abf-9744-920c3dedec5d None None] Releasing lock "compute-rpcapi-router" {{(pid=132531) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 19:39:31.460770 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5682aaf8-2f8e-4abf-9744-920c3dedec5d None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161912 Aug 17 19:39:31.461750 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 34/62] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:39:31.467467 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1738dc2c-d32a-4d09-83b5-7618b9e71e64 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:31.468512 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1738dc2c-d32a-4d09-83b5-7618b9e71e64 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:31.480698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1738dc2c-d32a-4d09-83b5-7618b9e71e64 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:31.483932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1738dc2c-d32a-4d09-83b5-7618b9e71e64 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:31.484646 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1738dc2c-d32a-4d09-83b5-7618b9e71e64 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:31.488301 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1738dc2c-d32a-4d09-83b5-7618b9e71e64 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:31.489060 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1738dc2c-d32a-4d09-83b5-7618b9e71e64 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:31.489804 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1738dc2c-d32a-4d09-83b5-7618b9e71e64 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:31.958666 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1738dc2c-d32a-4d09-83b5-7618b9e71e64 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:31.971304 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1738dc2c-d32a-4d09-83b5-7618b9e71e64 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:31.972798 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1738dc2c-d32a-4d09-83b5-7618b9e71e64 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:31.986230 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1738dc2c-d32a-4d09-83b5-7618b9e71e64 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1338 microversion: 2.20 time: 0.523016 Aug 17 19:39:31.997245 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 35/63] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:31 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1338 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:32.003078 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-edbe4c0e-b0c9-455b-a6c7-415bc8e3d562 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:32.003078 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-edbe4c0e-b0c9-455b-a6c7-415bc8e3d562 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:32.026131 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-edbe4c0e-b0c9-455b-a6c7-415bc8e3d562 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:32.026670 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-edbe4c0e-b0c9-455b-a6c7-415bc8e3d562 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:32.037423 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-edbe4c0e-b0c9-455b-a6c7-415bc8e3d562 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:32.043406 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-edbe4c0e-b0c9-455b-a6c7-415bc8e3d562 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:32.044103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-edbe4c0e-b0c9-455b-a6c7-415bc8e3d562 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:32.044775 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-edbe4c0e-b0c9-455b-a6c7-415bc8e3d562 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:32.707323 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-4a06d78d-13ae-4394-8d7f-b239387c7915 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:32.739214 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4a06d78d-13ae-4394-8d7f-b239387c7915 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 2.036758 Aug 17 19:39:32.740449 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 29/64] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:30 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:32.770276 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2684ad15-3d12-44ba-b281-6d6ba146aa8e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:32.771402 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2684ad15-3d12-44ba-b281-6d6ba146aa8e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:32.787795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2684ad15-3d12-44ba-b281-6d6ba146aa8e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:32.789795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2684ad15-3d12-44ba-b281-6d6ba146aa8e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:32.793729 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2684ad15-3d12-44ba-b281-6d6ba146aa8e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:32.801565 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2684ad15-3d12-44ba-b281-6d6ba146aa8e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:32.802326 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2684ad15-3d12-44ba-b281-6d6ba146aa8e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:32.803547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2684ad15-3d12-44ba-b281-6d6ba146aa8e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:32.872820 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=61 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:33.117869 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-2684ad15-3d12-44ba-b281-6d6ba146aa8e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:33.125777 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2684ad15-3d12-44ba-b281-6d6ba146aa8e tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1296 microversion: 2.1 time: 0.383424 Aug 17 19:39:33.136478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 30/65] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:32 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1296 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:33.138280 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-edbe4c0e-b0c9-455b-a6c7-415bc8e3d562 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:33.157733 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-edbe4c0e-b0c9-455b-a6c7-415bc8e3d562 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 1.159135 Aug 17 19:39:33.160313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 36/66] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:31 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:33.179598 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0096d0fd-24d0-4aec-acef-3577ea62ba2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:33.182689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0096d0fd-24d0-4aec-acef-3577ea62ba2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:33.195498 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0096d0fd-24d0-4aec-acef-3577ea62ba2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:33.198013 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0096d0fd-24d0-4aec-acef-3577ea62ba2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:33.199395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0096d0fd-24d0-4aec-acef-3577ea62ba2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:33.200154 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0096d0fd-24d0-4aec-acef-3577ea62ba2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:33.202669 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0096d0fd-24d0-4aec-acef-3577ea62ba2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:33.203168 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0096d0fd-24d0-4aec-acef-3577ea62ba2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:33.376345 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0096d0fd-24d0-4aec-acef-3577ea62ba2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:33.390281 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0096d0fd-24d0-4aec-acef-3577ea62ba2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:33.398912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0096d0fd-24d0-4aec-acef-3577ea62ba2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:33.403681 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0096d0fd-24d0-4aec-acef-3577ea62ba2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1338 microversion: 2.20 time: 0.240555 Aug 17 19:39:33.407851 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 37/67] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:33 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1338 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:33.557042 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-da10b451-7394-443f-9f5a-7870fa9c17bd req-a0e8b6da-28c2-4b9b-8fe1-cd62b5a5e9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e75fe34-cc76-4a62-b545-c2419fc4789d", "tag": "a76528d3-da4d-4b10-9dcb-381d2ede6e64"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:33.584207 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=10 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:33.589463 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-da10b451-7394-443f-9f5a-7870fa9c17bd req-a0e8b6da-28c2-4b9b-8fe1-cd62b5a5e9b3 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:33.590514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-da10b451-7394-443f-9f5a-7870fa9c17bd req-a0e8b6da-28c2-4b9b-8fe1-cd62b5a5e9b3 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:33.590956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-da10b451-7394-443f-9f5a-7870fa9c17bd req-a0e8b6da-28c2-4b9b-8fe1-cd62b5a5e9b3 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:33.612039 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-da10b451-7394-443f-9f5a-7870fa9c17bd req-a0e8b6da-28c2-4b9b-8fe1-cd62b5a5e9b3 service nova] Creating event network-changed:a76528d3-da4d-4b10-9dcb-381d2ede6e64 for instance 9e75fe34-cc76-4a62-b545-c2419fc4789d on hv-cinder-85069 Aug 17 19:39:33.631115 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-da10b451-7394-443f-9f5a-7870fa9c17bd req-a0e8b6da-28c2-4b9b-8fe1-cd62b5a5e9b3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.498686 Aug 17 19:39:33.631739 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 31/68] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:33.774382 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-24e35179-cccd-4f69-9511-f0d91a01f34f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:33.775258 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-24e35179-cccd-4f69-9511-f0d91a01f34f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:33.811958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-24e35179-cccd-4f69-9511-f0d91a01f34f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:33.812623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-24e35179-cccd-4f69-9511-f0d91a01f34f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:33.813463 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-24e35179-cccd-4f69-9511-f0d91a01f34f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:33.816805 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-24e35179-cccd-4f69-9511-f0d91a01f34f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:33.817609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-24e35179-cccd-4f69-9511-f0d91a01f34f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:33.819866 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-24e35179-cccd-4f69-9511-f0d91a01f34f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:34.141906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-24e35179-cccd-4f69-9511-f0d91a01f34f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:34.152613 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b51097d6-0774-4315-a980-f53c19619458 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:34.162819 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b51097d6-0774-4315-a980-f53c19619458 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:34.163730 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-24e35179-cccd-4f69-9511-f0d91a01f34f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.393693 Aug 17 19:39:34.164398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 38/69] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:33 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:34.171218 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b51097d6-0774-4315-a980-f53c19619458 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:34.171713 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b51097d6-0774-4315-a980-f53c19619458 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:34.172166 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b51097d6-0774-4315-a980-f53c19619458 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:34.172847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b51097d6-0774-4315-a980-f53c19619458 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:34.174849 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b51097d6-0774-4315-a980-f53c19619458 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:34.180715 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b51097d6-0774-4315-a980-f53c19619458 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:34.183593 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-540cc560-a0cd-4d24-97fc-04f27d990fd7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:34.184308 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-540cc560-a0cd-4d24-97fc-04f27d990fd7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:34.201963 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-540cc560-a0cd-4d24-97fc-04f27d990fd7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:34.202828 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-540cc560-a0cd-4d24-97fc-04f27d990fd7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:34.203967 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-540cc560-a0cd-4d24-97fc-04f27d990fd7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:34.206390 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-540cc560-a0cd-4d24-97fc-04f27d990fd7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:34.206971 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-540cc560-a0cd-4d24-97fc-04f27d990fd7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:34.208687 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-540cc560-a0cd-4d24-97fc-04f27d990fd7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:34.438462 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b51097d6-0774-4315-a980-f53c19619458 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:34.461754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b51097d6-0774-4315-a980-f53c19619458 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1364 microversion: 2.1 time: 0.313247 Aug 17 19:39:34.463304 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 32/70] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:34 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:34.471765 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-9c096012-aa6e-41d6-89ee-131ea6aa9566 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:34.472772 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9c096012-aa6e-41d6-89ee-131ea6aa9566 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:34.478115 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-540cc560-a0cd-4d24-97fc-04f27d990fd7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:34.487860 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c096012-aa6e-41d6-89ee-131ea6aa9566 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:34.488589 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c096012-aa6e-41d6-89ee-131ea6aa9566 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:34.489025 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c096012-aa6e-41d6-89ee-131ea6aa9566 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:34.489922 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c096012-aa6e-41d6-89ee-131ea6aa9566 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:34.491132 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c096012-aa6e-41d6-89ee-131ea6aa9566 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:34.491714 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c096012-aa6e-41d6-89ee-131ea6aa9566 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:34.494636 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-540cc560-a0cd-4d24-97fc-04f27d990fd7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.318717 Aug 17 19:39:34.497465 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 39/71] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:34 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:34.659187 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9c096012-aa6e-41d6-89ee-131ea6aa9566 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:34.667862 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9c096012-aa6e-41d6-89ee-131ea6aa9566 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:34.669411 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9c096012-aa6e-41d6-89ee-131ea6aa9566 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:34.670546 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-9c096012-aa6e-41d6-89ee-131ea6aa9566 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1406 microversion: 2.20 time: 0.205225 Aug 17 19:39:34.671639 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 33/72] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:34 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:35.188272 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9ac6e03d-90ef-4bd2-877c-155b84520d56 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:35.189021 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9ac6e03d-90ef-4bd2-877c-155b84520d56 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:35.197334 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:35.206603 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9ac6e03d-90ef-4bd2-877c-155b84520d56 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:35.206872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9ac6e03d-90ef-4bd2-877c-155b84520d56 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:35.207452 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9ac6e03d-90ef-4bd2-877c-155b84520d56 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:35.208440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9ac6e03d-90ef-4bd2-877c-155b84520d56 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:35.209142 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9ac6e03d-90ef-4bd2-877c-155b84520d56 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:35.209742 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9ac6e03d-90ef-4bd2-877c-155b84520d56 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:35.392961 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9ac6e03d-90ef-4bd2-877c-155b84520d56 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:35.401146 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9ac6e03d-90ef-4bd2-877c-155b84520d56 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.218311 Aug 17 19:39:35.407611 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 40/73] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:35 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:35.484180 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-152510b3-e493-4ad4-afee-d7d79b3538e2 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:35.485455 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-152510b3-e493-4ad4-afee-d7d79b3538e2 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:35.487393 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=26 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:35.493430 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-152510b3-e493-4ad4-afee-d7d79b3538e2 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:35.494189 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-152510b3-e493-4ad4-afee-d7d79b3538e2 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:35.494871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-152510b3-e493-4ad4-afee-d7d79b3538e2 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:35.495904 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-152510b3-e493-4ad4-afee-d7d79b3538e2 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:35.496507 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-152510b3-e493-4ad4-afee-d7d79b3538e2 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:35.497066 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-152510b3-e493-4ad4-afee-d7d79b3538e2 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:35.518088 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-375a9bb2-86e8-44a1-ac7f-fdd3cc2f6c7d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:35.518911 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-375a9bb2-86e8-44a1-ac7f-fdd3cc2f6c7d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:35.529853 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-375a9bb2-86e8-44a1-ac7f-fdd3cc2f6c7d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:35.530695 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-375a9bb2-86e8-44a1-ac7f-fdd3cc2f6c7d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:35.531309 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-375a9bb2-86e8-44a1-ac7f-fdd3cc2f6c7d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:35.532190 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-375a9bb2-86e8-44a1-ac7f-fdd3cc2f6c7d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:35.532791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-375a9bb2-86e8-44a1-ac7f-fdd3cc2f6c7d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:35.533411 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-375a9bb2-86e8-44a1-ac7f-fdd3cc2f6c7d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:35.753100 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-152510b3-e493-4ad4-afee-d7d79b3538e2 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:35.757484 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-375a9bb2-86e8-44a1-ac7f-fdd3cc2f6c7d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:35.764726 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-152510b3-e493-4ad4-afee-d7d79b3538e2 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1364 microversion: 2.1 time: 0.284333 Aug 17 19:39:35.765395 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 34/74] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:35 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:35.766733 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-375a9bb2-86e8-44a1-ac7f-fdd3cc2f6c7d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.252906 Aug 17 19:39:35.774248 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-916bcdd9-c26c-40ae-8b8c-af993bfb7132 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:35.775084 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-916bcdd9-c26c-40ae-8b8c-af993bfb7132 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:35.780201 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 41/75] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:35 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:35.781706 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-916bcdd9-c26c-40ae-8b8c-af993bfb7132 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:35.782186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-916bcdd9-c26c-40ae-8b8c-af993bfb7132 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:35.782812 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-916bcdd9-c26c-40ae-8b8c-af993bfb7132 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:35.783497 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-916bcdd9-c26c-40ae-8b8c-af993bfb7132 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:35.783945 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-916bcdd9-c26c-40ae-8b8c-af993bfb7132 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:35.784360 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-916bcdd9-c26c-40ae-8b8c-af993bfb7132 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:35.927066 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-916bcdd9-c26c-40ae-8b8c-af993bfb7132 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:35.935270 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-916bcdd9-c26c-40ae-8b8c-af993bfb7132 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:35.936836 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-916bcdd9-c26c-40ae-8b8c-af993bfb7132 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:35.938001 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-916bcdd9-c26c-40ae-8b8c-af993bfb7132 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1406 microversion: 2.20 time: 0.171512 Aug 17 19:39:35.938564 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 35/76] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:35 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:36.423437 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-db68bc1d-fffd-4f54-9ef0-4a8f74f3f38c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:36.425419 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-db68bc1d-fffd-4f54-9ef0-4a8f74f3f38c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:36.435021 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-db68bc1d-fffd-4f54-9ef0-4a8f74f3f38c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:36.435600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-db68bc1d-fffd-4f54-9ef0-4a8f74f3f38c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:36.436038 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-db68bc1d-fffd-4f54-9ef0-4a8f74f3f38c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:36.439937 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-db68bc1d-fffd-4f54-9ef0-4a8f74f3f38c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:36.440837 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-db68bc1d-fffd-4f54-9ef0-4a8f74f3f38c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:36.442257 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-db68bc1d-fffd-4f54-9ef0-4a8f74f3f38c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:36.454189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=100 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:36.605676 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-13747b0b-64b8-4bd7-b602-5809fe175645 req-bb3e8e0c-49a5-4ace-9cb9-304aa48121b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0602879a-bbc5-4632-8412-a72ea55b9068", "tag": "6a3e0e5d-86b3-4661-9b06-02498556723f"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:36.630449 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-13747b0b-64b8-4bd7-b602-5809fe175645 req-bb3e8e0c-49a5-4ace-9cb9-304aa48121b3 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:36.632905 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-13747b0b-64b8-4bd7-b602-5809fe175645 req-bb3e8e0c-49a5-4ace-9cb9-304aa48121b3 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:36.633754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-13747b0b-64b8-4bd7-b602-5809fe175645 req-bb3e8e0c-49a5-4ace-9cb9-304aa48121b3 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:36.680168 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-13747b0b-64b8-4bd7-b602-5809fe175645 req-bb3e8e0c-49a5-4ace-9cb9-304aa48121b3 service nova] Creating event network-changed:6a3e0e5d-86b3-4661-9b06-02498556723f for instance 0602879a-bbc5-4632-8412-a72ea55b9068 on hv-cinder-85069 Aug 17 19:39:36.688752 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-13747b0b-64b8-4bd7-b602-5809fe175645 req-bb3e8e0c-49a5-4ace-9cb9-304aa48121b3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091818 Aug 17 19:39:36.690127 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 36/77] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:39:36.787596 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e168cdf9-2226-482d-be45-72cbd2cf2fd4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:36.788573 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e168cdf9-2226-482d-be45-72cbd2cf2fd4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:36.801741 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e168cdf9-2226-482d-be45-72cbd2cf2fd4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:36.803647 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e168cdf9-2226-482d-be45-72cbd2cf2fd4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:36.805585 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e168cdf9-2226-482d-be45-72cbd2cf2fd4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:36.806935 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e168cdf9-2226-482d-be45-72cbd2cf2fd4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:36.810090 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e168cdf9-2226-482d-be45-72cbd2cf2fd4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:36.813235 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e168cdf9-2226-482d-be45-72cbd2cf2fd4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:36.816165 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-db68bc1d-fffd-4f54-9ef0-4a8f74f3f38c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:36.829408 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-db68bc1d-fffd-4f54-9ef0-4a8f74f3f38c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.410676 Aug 17 19:39:36.844415 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 42/78] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:36 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:36.844415 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5da21f5e-8bf2-4151-9648-50cbeab18311 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:36.844415 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5da21f5e-8bf2-4151-9648-50cbeab18311 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:36.859832 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5da21f5e-8bf2-4151-9648-50cbeab18311 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:36.862405 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5da21f5e-8bf2-4151-9648-50cbeab18311 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:36.864755 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5da21f5e-8bf2-4151-9648-50cbeab18311 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:36.865652 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5da21f5e-8bf2-4151-9648-50cbeab18311 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:36.867460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5da21f5e-8bf2-4151-9648-50cbeab18311 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:36.868571 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5da21f5e-8bf2-4151-9648-50cbeab18311 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:37.168042 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e168cdf9-2226-482d-be45-72cbd2cf2fd4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:37.174991 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e168cdf9-2226-482d-be45-72cbd2cf2fd4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1364 microversion: 2.1 time: 0.392337 Aug 17 19:39:37.182297 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 37/79] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:36 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1364 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:39:37.205822 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-da3aa77a-9352-4dc5-bc3e-3f0f1616e38d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:37.209143 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-da3aa77a-9352-4dc5-bc3e-3f0f1616e38d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:37.215987 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=22 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:37.225670 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-da3aa77a-9352-4dc5-bc3e-3f0f1616e38d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:37.228585 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-da3aa77a-9352-4dc5-bc3e-3f0f1616e38d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:37.230800 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-da3aa77a-9352-4dc5-bc3e-3f0f1616e38d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:37.235230 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-da3aa77a-9352-4dc5-bc3e-3f0f1616e38d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:37.235958 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-da3aa77a-9352-4dc5-bc3e-3f0f1616e38d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:37.236659 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-da3aa77a-9352-4dc5-bc3e-3f0f1616e38d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:37.273720 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5da21f5e-8bf2-4151-9648-50cbeab18311 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:37.286526 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5da21f5e-8bf2-4151-9648-50cbeab18311 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.451947 Aug 17 19:39:37.287164 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 43/80] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:36 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:37.519752 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-da3aa77a-9352-4dc5-bc3e-3f0f1616e38d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:37.530256 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-da3aa77a-9352-4dc5-bc3e-3f0f1616e38d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:37.532027 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-da3aa77a-9352-4dc5-bc3e-3f0f1616e38d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:37.533547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-da3aa77a-9352-4dc5-bc3e-3f0f1616e38d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1406 microversion: 2.20 time: 0.350069 Aug 17 19:39:37.534648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 38/81] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:37 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1406 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:37.854780 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6c45aa1b-85b1-4ef8-b4fa-02ebf770ed38 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:37.856624 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6c45aa1b-85b1-4ef8-b4fa-02ebf770ed38 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:37.866692 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6c45aa1b-85b1-4ef8-b4fa-02ebf770ed38 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:37.867592 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6c45aa1b-85b1-4ef8-b4fa-02ebf770ed38 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:37.868407 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6c45aa1b-85b1-4ef8-b4fa-02ebf770ed38 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:37.869526 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6c45aa1b-85b1-4ef8-b4fa-02ebf770ed38 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:37.870081 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6c45aa1b-85b1-4ef8-b4fa-02ebf770ed38 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:37.874956 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6c45aa1b-85b1-4ef8-b4fa-02ebf770ed38 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:38.096609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6c45aa1b-85b1-4ef8-b4fa-02ebf770ed38 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:38.104914 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6c45aa1b-85b1-4ef8-b4fa-02ebf770ed38 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.256731 Aug 17 19:39:38.105864 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 44/82] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:37 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:38.195957 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1b854583-f637-47d4-bd41-6f1c0ca14132 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:38.197256 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1b854583-f637-47d4-bd41-6f1c0ca14132 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:38.206618 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1b854583-f637-47d4-bd41-6f1c0ca14132 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:38.207347 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1b854583-f637-47d4-bd41-6f1c0ca14132 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:38.207957 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1b854583-f637-47d4-bd41-6f1c0ca14132 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:38.208648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1b854583-f637-47d4-bd41-6f1c0ca14132 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:38.209094 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1b854583-f637-47d4-bd41-6f1c0ca14132 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:38.210025 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1b854583-f637-47d4-bd41-6f1c0ca14132 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:38.310337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e96ff611-b917-483e-b4c9-5d2673e27e8b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:38.311311 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e96ff611-b917-483e-b4c9-5d2673e27e8b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:38.322937 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e96ff611-b917-483e-b4c9-5d2673e27e8b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:38.325106 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e96ff611-b917-483e-b4c9-5d2673e27e8b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:38.327538 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e96ff611-b917-483e-b4c9-5d2673e27e8b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:38.331624 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e96ff611-b917-483e-b4c9-5d2673e27e8b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:38.332435 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e96ff611-b917-483e-b4c9-5d2673e27e8b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:38.333039 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e96ff611-b917-483e-b4c9-5d2673e27e8b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:38.488286 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1b854583-f637-47d4-bd41-6f1c0ca14132 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:38.506595 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1b854583-f637-47d4-bd41-6f1c0ca14132 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1364 microversion: 2.1 time: 0.314344 Aug 17 19:39:38.513304 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 39/83] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:38 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:38.551606 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e96ff611-b917-483e-b4c9-5d2673e27e8b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:38.556198 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-21b97de6-b429-4a92-8377-1632fafffdf0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:38.556808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-21b97de6-b429-4a92-8377-1632fafffdf0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:38.561171 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e96ff611-b917-483e-b4c9-5d2673e27e8b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.254923 Aug 17 19:39:38.565396 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 45/84] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:38 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:39:38.565548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-21b97de6-b429-4a92-8377-1632fafffdf0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:38.565548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-21b97de6-b429-4a92-8377-1632fafffdf0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:38.565548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-21b97de6-b429-4a92-8377-1632fafffdf0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:38.565548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-21b97de6-b429-4a92-8377-1632fafffdf0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:38.565813 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-21b97de6-b429-4a92-8377-1632fafffdf0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:38.565813 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-21b97de6-b429-4a92-8377-1632fafffdf0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:38.716245 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-21b97de6-b429-4a92-8377-1632fafffdf0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:38.725568 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-21b97de6-b429-4a92-8377-1632fafffdf0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:38.727383 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-21b97de6-b429-4a92-8377-1632fafffdf0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:38.728871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-21b97de6-b429-4a92-8377-1632fafffdf0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1406 microversion: 2.20 time: 0.176701 Aug 17 19:39:38.740843 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-4be6e817-3ea9-4c94-aa41-11322c7a43c3 req-4341929e-cad4-4181-bce5-2285979dc505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b04daa67-36a6-4a53-b80a-e90f77348028", "tag": "8692c85c-fc9f-49cd-bff2-6ddd975dd053"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:38.744245 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 40/85] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:38 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:39:38.762140 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-4be6e817-3ea9-4c94-aa41-11322c7a43c3 req-4341929e-cad4-4181-bce5-2285979dc505 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:38.763379 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-4be6e817-3ea9-4c94-aa41-11322c7a43c3 req-4341929e-cad4-4181-bce5-2285979dc505 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:38.763818 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-4be6e817-3ea9-4c94-aa41-11322c7a43c3 req-4341929e-cad4-4181-bce5-2285979dc505 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:38.786495 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-4be6e817-3ea9-4c94-aa41-11322c7a43c3 req-4341929e-cad4-4181-bce5-2285979dc505 service nova] Creating event network-changed:8692c85c-fc9f-49cd-bff2-6ddd975dd053 for instance b04daa67-36a6-4a53-b80a-e90f77348028 on hv-cinder-85069 Aug 17 19:39:38.796320 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-4be6e817-3ea9-4c94-aa41-11322c7a43c3 req-4341929e-cad4-4181-bce5-2285979dc505 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059455 Aug 17 19:39:38.797537 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 46/86] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:39.127060 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ae39c217-311e-4166-889a-22135441e2b2 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:39.127664 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ae39c217-311e-4166-889a-22135441e2b2 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:39.133491 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=8 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:39.135054 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ae39c217-311e-4166-889a-22135441e2b2 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:39.135844 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ae39c217-311e-4166-889a-22135441e2b2 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:39.136475 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ae39c217-311e-4166-889a-22135441e2b2 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:39.137436 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ae39c217-311e-4166-889a-22135441e2b2 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:39.138028 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ae39c217-311e-4166-889a-22135441e2b2 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:39.138575 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ae39c217-311e-4166-889a-22135441e2b2 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:39.329528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ae39c217-311e-4166-889a-22135441e2b2 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:39.342411 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ae39c217-311e-4166-889a-22135441e2b2 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.219906 Aug 17 19:39:39.343425 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 41/87] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:39 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:39.531378 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b7700bf2-7a3f-42b5-8a34-013397dd6c08 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:39.532079 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b7700bf2-7a3f-42b5-8a34-013397dd6c08 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:39.545132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b7700bf2-7a3f-42b5-8a34-013397dd6c08 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:39.546638 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b7700bf2-7a3f-42b5-8a34-013397dd6c08 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:39.547289 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b7700bf2-7a3f-42b5-8a34-013397dd6c08 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:39.548441 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b7700bf2-7a3f-42b5-8a34-013397dd6c08 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:39.549012 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b7700bf2-7a3f-42b5-8a34-013397dd6c08 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:39.551839 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b7700bf2-7a3f-42b5-8a34-013397dd6c08 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:39.590996 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d527e092-0f3d-46d1-9c53-f3439081952d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:39.591915 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d527e092-0f3d-46d1-9c53-f3439081952d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:39.599382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d527e092-0f3d-46d1-9c53-f3439081952d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:39.600049 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d527e092-0f3d-46d1-9c53-f3439081952d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:39.600787 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d527e092-0f3d-46d1-9c53-f3439081952d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:39.601875 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d527e092-0f3d-46d1-9c53-f3439081952d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:39.603099 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d527e092-0f3d-46d1-9c53-f3439081952d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:39.603736 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d527e092-0f3d-46d1-9c53-f3439081952d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:39.971587 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b7700bf2-7a3f-42b5-8a34-013397dd6c08 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:39.980627 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b7700bf2-7a3f-42b5-8a34-013397dd6c08 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1364 microversion: 2.1 time: 0.456243 Aug 17 19:39:39.985309 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 47/88] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:39 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1364 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:40.067684 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d527e092-0f3d-46d1-9c53-f3439081952d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:40.084645 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d527e092-0f3d-46d1-9c53-f3439081952d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.492796 Aug 17 19:39:40.085909 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 42/89] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:39 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:40.098575 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3a7dd59a-e94f-4c0a-9316-ab311df65b69 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:40.098575 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3a7dd59a-e94f-4c0a-9316-ab311df65b69 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:40.116035 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a7dd59a-e94f-4c0a-9316-ab311df65b69 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:40.116867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a7dd59a-e94f-4c0a-9316-ab311df65b69 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:40.118659 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a7dd59a-e94f-4c0a-9316-ab311df65b69 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:40.120438 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a7dd59a-e94f-4c0a-9316-ab311df65b69 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:40.121292 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a7dd59a-e94f-4c0a-9316-ab311df65b69 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:40.123821 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a7dd59a-e94f-4c0a-9316-ab311df65b69 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:40.377468 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3a7dd59a-e94f-4c0a-9316-ab311df65b69 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:40.387787 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3a7dd59a-e94f-4c0a-9316-ab311df65b69 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:40.393879 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3a7dd59a-e94f-4c0a-9316-ab311df65b69 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:40.395469 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3a7dd59a-e94f-4c0a-9316-ab311df65b69 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1406 microversion: 2.20 time: 0.308527 Aug 17 19:39:40.396210 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 43/90] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:40 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:40.401570 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3d4aa826-d736-4249-b211-f645791b6f97 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:40.402524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3d4aa826-d736-4249-b211-f645791b6f97 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:40.409529 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3d4aa826-d736-4249-b211-f645791b6f97 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:40.410219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3d4aa826-d736-4249-b211-f645791b6f97 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:40.410900 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3d4aa826-d736-4249-b211-f645791b6f97 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:40.412405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3d4aa826-d736-4249-b211-f645791b6f97 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:40.413260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3d4aa826-d736-4249-b211-f645791b6f97 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:40.413983 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3d4aa826-d736-4249-b211-f645791b6f97 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:40.458806 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-44c4468a-f541-4087-a4d2-185e61b3b8dc req-4eec1928-99df-4ba4-b56f-f2e3849343fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001bd590-d203-4670-aef3-300aae8d4c4f", "name": "network-vif-plugged", "status": "completed", "tag": "00265e2e-29dc-406a-a2b2-cd2bb162da12"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:40.473539 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-44c4468a-f541-4087-a4d2-185e61b3b8dc req-4eec1928-99df-4ba4-b56f-f2e3849343fd service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:40.478997 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-44c4468a-f541-4087-a4d2-185e61b3b8dc req-4eec1928-99df-4ba4-b56f-f2e3849343fd service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:40.481296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-44c4468a-f541-4087-a4d2-185e61b3b8dc req-4eec1928-99df-4ba4-b56f-f2e3849343fd service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:40.501428 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-44c4468a-f541-4087-a4d2-185e61b3b8dc req-4eec1928-99df-4ba4-b56f-f2e3849343fd service nova] Creating event network-vif-plugged:00265e2e-29dc-406a-a2b2-cd2bb162da12 for instance 001bd590-d203-4670-aef3-300aae8d4c4f on hv-cinder-85069 Aug 17 19:39:40.520480 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-44c4468a-f541-4087-a4d2-185e61b3b8dc req-4eec1928-99df-4ba4-b56f-f2e3849343fd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.533893 Aug 17 19:39:40.521086 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 48/91] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:40.636432 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3d4aa826-d736-4249-b211-f645791b6f97 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:40.651194 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3d4aa826-d736-4249-b211-f645791b6f97 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.253679 Aug 17 19:39:40.654993 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 44/92] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:40 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:41.011608 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a37efc78-285f-4026-bdd2-068e580b3319 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:41.012903 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a37efc78-285f-4026-bdd2-068e580b3319 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:41.020263 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a37efc78-285f-4026-bdd2-068e580b3319 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:41.020912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a37efc78-285f-4026-bdd2-068e580b3319 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:41.021556 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a37efc78-285f-4026-bdd2-068e580b3319 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:41.022678 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a37efc78-285f-4026-bdd2-068e580b3319 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:41.023283 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a37efc78-285f-4026-bdd2-068e580b3319 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:41.023855 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a37efc78-285f-4026-bdd2-068e580b3319 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:41.110231 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f42c6f6e-f3c9-45ae-8175-1145e499d858 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:41.111134 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f42c6f6e-f3c9-45ae-8175-1145e499d858 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:41.119936 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f42c6f6e-f3c9-45ae-8175-1145e499d858 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:41.126794 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f42c6f6e-f3c9-45ae-8175-1145e499d858 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:41.127222 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f42c6f6e-f3c9-45ae-8175-1145e499d858 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:41.128383 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f42c6f6e-f3c9-45ae-8175-1145e499d858 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:41.129281 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f42c6f6e-f3c9-45ae-8175-1145e499d858 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:41.129926 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f42c6f6e-f3c9-45ae-8175-1145e499d858 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:41.357814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a37efc78-285f-4026-bdd2-068e580b3319 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:41.370875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a37efc78-285f-4026-bdd2-068e580b3319 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1364 microversion: 2.1 time: 0.363509 Aug 17 19:39:41.372408 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 49/93] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:41 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1364 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:41.415333 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=6 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:41.421265 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-2de225bf-0867-4e7f-ba66-59ae74669245 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:41.421956 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-2de225bf-0867-4e7f-ba66-59ae74669245 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:41.435733 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2de225bf-0867-4e7f-ba66-59ae74669245 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:41.437906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2de225bf-0867-4e7f-ba66-59ae74669245 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:41.438362 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2de225bf-0867-4e7f-ba66-59ae74669245 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:41.441003 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2de225bf-0867-4e7f-ba66-59ae74669245 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:41.441519 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2de225bf-0867-4e7f-ba66-59ae74669245 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:41.441961 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2de225bf-0867-4e7f-ba66-59ae74669245 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:41.479973 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f42c6f6e-f3c9-45ae-8175-1145e499d858 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:41.493137 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f42c6f6e-f3c9-45ae-8175-1145e499d858 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.387834 Aug 17 19:39:41.494497 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 45/94] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:41 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:41.674246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-32e81f0c-492d-43a5-b3fb-c267a337eee6 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:41.675037 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-32e81f0c-492d-43a5-b3fb-c267a337eee6 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:41.685169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-32e81f0c-492d-43a5-b3fb-c267a337eee6 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:41.688413 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-32e81f0c-492d-43a5-b3fb-c267a337eee6 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:41.688964 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-32e81f0c-492d-43a5-b3fb-c267a337eee6 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:41.689814 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-32e81f0c-492d-43a5-b3fb-c267a337eee6 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:41.693541 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-32e81f0c-492d-43a5-b3fb-c267a337eee6 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:41.694131 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-32e81f0c-492d-43a5-b3fb-c267a337eee6 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:41.695801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2de225bf-0867-4e7f-ba66-59ae74669245 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:41.709295 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2de225bf-0867-4e7f-ba66-59ae74669245 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:41.713324 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2de225bf-0867-4e7f-ba66-59ae74669245 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:41.720541 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-2de225bf-0867-4e7f-ba66-59ae74669245 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1406 microversion: 2.20 time: 0.303483 Aug 17 19:39:41.737993 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 50/95] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:41 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:41.899847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-32e81f0c-492d-43a5-b3fb-c267a337eee6 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:41.908956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-32e81f0c-492d-43a5-b3fb-c267a337eee6 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.238887 Aug 17 19:39:41.922263 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 46/96] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:41 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:42.393599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1193660a-50e9-4cdc-acdf-d5c43317534f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:42.394805 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1193660a-50e9-4cdc-acdf-d5c43317534f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:42.401022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1193660a-50e9-4cdc-acdf-d5c43317534f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:42.401539 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1193660a-50e9-4cdc-acdf-d5c43317534f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:42.401979 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1193660a-50e9-4cdc-acdf-d5c43317534f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:42.402674 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1193660a-50e9-4cdc-acdf-d5c43317534f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:42.403125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1193660a-50e9-4cdc-acdf-d5c43317534f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:42.403550 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1193660a-50e9-4cdc-acdf-d5c43317534f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:42.518424 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-50c2014d-aba2-4c01-aca4-2640ed036213 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:42.519043 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-50c2014d-aba2-4c01-aca4-2640ed036213 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:42.525710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-50c2014d-aba2-4c01-aca4-2640ed036213 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:42.526195 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-50c2014d-aba2-4c01-aca4-2640ed036213 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:42.526645 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-50c2014d-aba2-4c01-aca4-2640ed036213 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:42.527325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-50c2014d-aba2-4c01-aca4-2640ed036213 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:42.527776 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-50c2014d-aba2-4c01-aca4-2640ed036213 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:42.528195 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-50c2014d-aba2-4c01-aca4-2640ed036213 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:42.606377 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1193660a-50e9-4cdc-acdf-d5c43317534f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:42.617172 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1193660a-50e9-4cdc-acdf-d5c43317534f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1364 microversion: 2.1 time: 0.226756 Aug 17 19:39:42.618112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 51/97] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:42 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:42.696044 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-50c2014d-aba2-4c01-aca4-2640ed036213 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:42.710179 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-50c2014d-aba2-4c01-aca4-2640ed036213 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.198414 Aug 17 19:39:42.710992 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 47/98] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:42 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:42.750633 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-626b155e-231c-4116-9dd7-9d0cc17b8a50 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:42.751411 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-626b155e-231c-4116-9dd7-9d0cc17b8a50 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:42.757453 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-626b155e-231c-4116-9dd7-9d0cc17b8a50 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:42.757930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-626b155e-231c-4116-9dd7-9d0cc17b8a50 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:42.758360 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-626b155e-231c-4116-9dd7-9d0cc17b8a50 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:42.759036 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-626b155e-231c-4116-9dd7-9d0cc17b8a50 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:42.759479 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-626b155e-231c-4116-9dd7-9d0cc17b8a50 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:42.759880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-626b155e-231c-4116-9dd7-9d0cc17b8a50 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:42.937880 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b8179494-2bff-435c-9542-e7923bc86df8 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:42.939173 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b8179494-2bff-435c-9542-e7923bc86df8 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:42.951279 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8179494-2bff-435c-9542-e7923bc86df8 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:42.952403 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8179494-2bff-435c-9542-e7923bc86df8 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:42.953073 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8179494-2bff-435c-9542-e7923bc86df8 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:42.953854 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8179494-2bff-435c-9542-e7923bc86df8 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:42.954483 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8179494-2bff-435c-9542-e7923bc86df8 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:42.954924 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8179494-2bff-435c-9542-e7923bc86df8 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:42.960541 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-626b155e-231c-4116-9dd7-9d0cc17b8a50 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:42.972662 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-626b155e-231c-4116-9dd7-9d0cc17b8a50 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:42.983654 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-626b155e-231c-4116-9dd7-9d0cc17b8a50 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:42.991269 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-626b155e-231c-4116-9dd7-9d0cc17b8a50 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1406 microversion: 2.20 time: 0.245005 Aug 17 19:39:42.993665 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 52/99] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:42 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:42.999968 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=100 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:43.240377 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b8179494-2bff-435c-9542-e7923bc86df8 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:43.255301 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b8179494-2bff-435c-9542-e7923bc86df8 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.327063 Aug 17 19:39:43.255884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 48/100] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:42 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:43.300083 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-debfebf0-be98-4e99-ae21-4637a7d32f84 req-904b80de-9c24-4ea5-80c2-8b884838915e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0602879a-bbc5-4632-8412-a72ea55b9068", "name": "network-vif-plugged", "status": "completed", "tag": "6a3e0e5d-86b3-4661-9b06-02498556723f"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:43.328646 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-debfebf0-be98-4e99-ae21-4637a7d32f84 req-904b80de-9c24-4ea5-80c2-8b884838915e service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:43.329132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-debfebf0-be98-4e99-ae21-4637a7d32f84 req-904b80de-9c24-4ea5-80c2-8b884838915e service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:43.329579 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-debfebf0-be98-4e99-ae21-4637a7d32f84 req-904b80de-9c24-4ea5-80c2-8b884838915e service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:43.361353 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-debfebf0-be98-4e99-ae21-4637a7d32f84 req-904b80de-9c24-4ea5-80c2-8b884838915e service nova] Creating event network-vif-plugged:6a3e0e5d-86b3-4661-9b06-02498556723f for instance 0602879a-bbc5-4632-8412-a72ea55b9068 on hv-cinder-85069 Aug 17 19:39:43.368618 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-debfebf0-be98-4e99-ae21-4637a7d32f84 req-904b80de-9c24-4ea5-80c2-8b884838915e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085048 Aug 17 19:39:43.370605 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 53/101] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:43.638248 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f6e7081b-bd42-40f1-ba6b-770dba69ee1a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:43.639367 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f6e7081b-bd42-40f1-ba6b-770dba69ee1a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:43.647641 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6e7081b-bd42-40f1-ba6b-770dba69ee1a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:43.648139 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6e7081b-bd42-40f1-ba6b-770dba69ee1a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:43.648638 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6e7081b-bd42-40f1-ba6b-770dba69ee1a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:43.649327 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6e7081b-bd42-40f1-ba6b-770dba69ee1a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:43.649783 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6e7081b-bd42-40f1-ba6b-770dba69ee1a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:43.650204 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6e7081b-bd42-40f1-ba6b-770dba69ee1a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:43.731745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-65624726-49c7-4f20-9854-f12356aebdd4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:43.734045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-65624726-49c7-4f20-9854-f12356aebdd4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:43.741619 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65624726-49c7-4f20-9854-f12356aebdd4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:43.742106 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65624726-49c7-4f20-9854-f12356aebdd4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:43.742537 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65624726-49c7-4f20-9854-f12356aebdd4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:43.743339 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65624726-49c7-4f20-9854-f12356aebdd4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:43.744500 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65624726-49c7-4f20-9854-f12356aebdd4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:43.744983 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65624726-49c7-4f20-9854-f12356aebdd4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:43.909630 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f6e7081b-bd42-40f1-ba6b-770dba69ee1a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:43.927869 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f6e7081b-bd42-40f1-ba6b-770dba69ee1a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1364 microversion: 2.1 time: 0.293329 Aug 17 19:39:43.942104 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 49/102] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:43 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1364 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:43.990601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-65624726-49c7-4f20-9854-f12356aebdd4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:43.998384 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-65624726-49c7-4f20-9854-f12356aebdd4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.271315 Aug 17 19:39:43.999088 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 54/103] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:43 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:44.016307 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-163db086-b250-4286-b614-ec93b35fa927 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:44.016913 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-163db086-b250-4286-b614-ec93b35fa927 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:44.026627 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-163db086-b250-4286-b614-ec93b35fa927 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:44.027450 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-163db086-b250-4286-b614-ec93b35fa927 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:44.028099 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-163db086-b250-4286-b614-ec93b35fa927 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:44.029036 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-163db086-b250-4286-b614-ec93b35fa927 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:44.030313 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-163db086-b250-4286-b614-ec93b35fa927 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:44.030944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-163db086-b250-4286-b614-ec93b35fa927 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:44.233792 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-163db086-b250-4286-b614-ec93b35fa927 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:44.242592 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-163db086-b250-4286-b614-ec93b35fa927 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:44.244107 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-163db086-b250-4286-b614-ec93b35fa927 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:44.245365 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-163db086-b250-4286-b614-ec93b35fa927 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1406 microversion: 2.20 time: 0.233393 Aug 17 19:39:44.246382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 50/104] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:44 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:44.275888 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a668c5f8-4900-4485-a79c-c006b0796247 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:44.276492 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a668c5f8-4900-4485-a79c-c006b0796247 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:44.287527 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a668c5f8-4900-4485-a79c-c006b0796247 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:44.288014 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a668c5f8-4900-4485-a79c-c006b0796247 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:44.288468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a668c5f8-4900-4485-a79c-c006b0796247 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:44.289179 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a668c5f8-4900-4485-a79c-c006b0796247 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:44.289649 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a668c5f8-4900-4485-a79c-c006b0796247 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:44.290065 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a668c5f8-4900-4485-a79c-c006b0796247 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:44.440351 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a668c5f8-4900-4485-a79c-c006b0796247 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:44.450199 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a668c5f8-4900-4485-a79c-c006b0796247 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.177946 Aug 17 19:39:44.452481 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 55/105] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:44 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:44.950156 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-41460a44-3418-4bd8-a191-a1ba85f7bc68 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:44.951143 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-41460a44-3418-4bd8-a191-a1ba85f7bc68 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:44.964038 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-41460a44-3418-4bd8-a191-a1ba85f7bc68 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:44.964855 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-41460a44-3418-4bd8-a191-a1ba85f7bc68 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:44.965340 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-41460a44-3418-4bd8-a191-a1ba85f7bc68 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:44.966044 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-41460a44-3418-4bd8-a191-a1ba85f7bc68 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:44.966493 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-41460a44-3418-4bd8-a191-a1ba85f7bc68 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:44.966911 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-41460a44-3418-4bd8-a191-a1ba85f7bc68 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:45.022693 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ccf84a6d-3fce-45c4-b844-d53abd56f8fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:45.023972 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ccf84a6d-3fce-45c4-b844-d53abd56f8fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:45.030724 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ccf84a6d-3fce-45c4-b844-d53abd56f8fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:45.031200 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ccf84a6d-3fce-45c4-b844-d53abd56f8fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:45.031976 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ccf84a6d-3fce-45c4-b844-d53abd56f8fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:45.032904 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ccf84a6d-3fce-45c4-b844-d53abd56f8fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:45.033396 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ccf84a6d-3fce-45c4-b844-d53abd56f8fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:45.033817 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ccf84a6d-3fce-45c4-b844-d53abd56f8fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:45.144605 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-41460a44-3418-4bd8-a191-a1ba85f7bc68 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:45.152249 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-41460a44-3418-4bd8-a191-a1ba85f7bc68 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1364 microversion: 2.1 time: 0.205861 Aug 17 19:39:45.152895 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 51/106] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:44 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:39:45.188158 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-ccf84a6d-3fce-45c4-b844-d53abd56f8fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:45.195558 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ccf84a6d-3fce-45c4-b844-d53abd56f8fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.179507 Aug 17 19:39:45.196119 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 56/107] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:45 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:39:45.269581 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c99da52c-7944-4c6f-b0f8-581ed35fc26d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:45.270216 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c99da52c-7944-4c6f-b0f8-581ed35fc26d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:45.276239 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c99da52c-7944-4c6f-b0f8-581ed35fc26d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:45.276751 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c99da52c-7944-4c6f-b0f8-581ed35fc26d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:45.277188 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c99da52c-7944-4c6f-b0f8-581ed35fc26d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:45.277923 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c99da52c-7944-4c6f-b0f8-581ed35fc26d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:45.278372 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c99da52c-7944-4c6f-b0f8-581ed35fc26d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:45.278790 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c99da52c-7944-4c6f-b0f8-581ed35fc26d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:45.395031 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-780adb10-d1bb-4ff3-941b-946335e3e695 req-972bcf0b-c85c-4c41-afc3-b937b359f618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e75fe34-cc76-4a62-b545-c2419fc4789d", "name": "network-vif-plugged", "status": "completed", "tag": "a76528d3-da4d-4b10-9dcb-381d2ede6e64"}, {"server_uuid": "55783dca-99fe-42bc-9e65-2c65038d0902", "name": "network-vif-plugged", "status": "completed", "tag": "31d9c9ee-a38e-4efd-a8af-b6989873b33d"}, {"server_uuid": "b04daa67-36a6-4a53-b80a-e90f77348028", "name": "network-vif-plugged", "status": "completed", "tag": "8692c85c-fc9f-49cd-bff2-6ddd975dd053"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:45.417886 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-780adb10-d1bb-4ff3-941b-946335e3e695 req-972bcf0b-c85c-4c41-afc3-b937b359f618 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:45.418690 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-780adb10-d1bb-4ff3-941b-946335e3e695 req-972bcf0b-c85c-4c41-afc3-b937b359f618 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:45.419262 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-780adb10-d1bb-4ff3-941b-946335e3e695 req-972bcf0b-c85c-4c41-afc3-b937b359f618 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:45.426170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c99da52c-7944-4c6f-b0f8-581ed35fc26d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:45.437523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-780adb10-d1bb-4ff3-941b-946335e3e695 req-972bcf0b-c85c-4c41-afc3-b937b359f618 service nova] Creating event network-vif-plugged:a76528d3-da4d-4b10-9dcb-381d2ede6e64 for instance 9e75fe34-cc76-4a62-b545-c2419fc4789d on hv-cinder-85069 Aug 17 19:39:45.438032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-780adb10-d1bb-4ff3-941b-946335e3e695 req-972bcf0b-c85c-4c41-afc3-b937b359f618 service nova] Creating event network-vif-plugged:31d9c9ee-a38e-4efd-a8af-b6989873b33d for instance 55783dca-99fe-42bc-9e65-2c65038d0902 on hv-cinder-85069 Aug 17 19:39:45.438533 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-780adb10-d1bb-4ff3-941b-946335e3e695 req-972bcf0b-c85c-4c41-afc3-b937b359f618 service nova] Creating event network-vif-plugged:8692c85c-fc9f-49cd-bff2-6ddd975dd053 for instance b04daa67-36a6-4a53-b80a-e90f77348028 on hv-cinder-85069 Aug 17 19:39:45.439016 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c99da52c-7944-4c6f-b0f8-581ed35fc26d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:45.441024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c99da52c-7944-4c6f-b0f8-581ed35fc26d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:45.442648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c99da52c-7944-4c6f-b0f8-581ed35fc26d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1406 microversion: 2.20 time: 0.177141 Aug 17 19:39:45.443306 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 52/108] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:45 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:39:45.447025 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-780adb10-d1bb-4ff3-941b-946335e3e695 req-972bcf0b-c85c-4c41-afc3-b937b359f618 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.058307 Aug 17 19:39:45.447626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 57/109] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:45.472171 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-99b8298a-58ae-4492-8984-929799e0955f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:45.472829 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-99b8298a-58ae-4492-8984-929799e0955f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:45.478763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-99b8298a-58ae-4492-8984-929799e0955f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:45.479243 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-99b8298a-58ae-4492-8984-929799e0955f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:45.479677 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-99b8298a-58ae-4492-8984-929799e0955f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:45.480351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-99b8298a-58ae-4492-8984-929799e0955f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:45.480816 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-99b8298a-58ae-4492-8984-929799e0955f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:45.481244 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-99b8298a-58ae-4492-8984-929799e0955f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:45.614838 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-99b8298a-58ae-4492-8984-929799e0955f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:45.623128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-99b8298a-58ae-4492-8984-929799e0955f tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.154665 Aug 17 19:39:45.624825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 53/110] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:45 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:46.176221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-59e83f8e-ac19-4869-978c-660838583f65 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:46.176915 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-59e83f8e-ac19-4869-978c-660838583f65 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:46.184471 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59e83f8e-ac19-4869-978c-660838583f65 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:46.186403 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59e83f8e-ac19-4869-978c-660838583f65 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:46.187181 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59e83f8e-ac19-4869-978c-660838583f65 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:46.187878 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59e83f8e-ac19-4869-978c-660838583f65 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:46.188325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59e83f8e-ac19-4869-978c-660838583f65 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:46.188745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59e83f8e-ac19-4869-978c-660838583f65 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:46.215669 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b8abee6b-e688-44fc-8fa3-44a5974dca32 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:46.216829 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b8abee6b-e688-44fc-8fa3-44a5974dca32 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:46.236342 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8abee6b-e688-44fc-8fa3-44a5974dca32 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:46.236830 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8abee6b-e688-44fc-8fa3-44a5974dca32 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:46.237282 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8abee6b-e688-44fc-8fa3-44a5974dca32 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:46.237980 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8abee6b-e688-44fc-8fa3-44a5974dca32 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:46.238495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8abee6b-e688-44fc-8fa3-44a5974dca32 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:46.238912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8abee6b-e688-44fc-8fa3-44a5974dca32 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:46.409612 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-59e83f8e-ac19-4869-978c-660838583f65 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:46.422615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-59e83f8e-ac19-4869-978c-660838583f65 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1550 microversion: 2.1 time: 0.250322 Aug 17 19:39:46.424002 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 58/111] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:46 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1550 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:46.445772 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b1b9cbcc-74e0-4bae-8a01-4bfbbd6ea09f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:46.447447 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b1b9cbcc-74e0-4bae-8a01-4bfbbd6ea09f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:46.455462 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b1b9cbcc-74e0-4bae-8a01-4bfbbd6ea09f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:46.456057 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b1b9cbcc-74e0-4bae-8a01-4bfbbd6ea09f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:46.456763 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b1b9cbcc-74e0-4bae-8a01-4bfbbd6ea09f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:46.458811 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b8abee6b-e688-44fc-8fa3-44a5974dca32 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:46.459514 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b1b9cbcc-74e0-4bae-8a01-4bfbbd6ea09f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:46.459996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b1b9cbcc-74e0-4bae-8a01-4bfbbd6ea09f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:46.461458 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b1b9cbcc-74e0-4bae-8a01-4bfbbd6ea09f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:46.473285 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b8abee6b-e688-44fc-8fa3-44a5974dca32 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.261168 Aug 17 19:39:46.474074 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 54/112] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:46 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:39:46.487835 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-de5cac2f-2ecd-442d-ae08-35d708a9adbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:46.488847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-de5cac2f-2ecd-442d-ae08-35d708a9adbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:46.496165 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de5cac2f-2ecd-442d-ae08-35d708a9adbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:46.496799 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de5cac2f-2ecd-442d-ae08-35d708a9adbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:46.497456 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de5cac2f-2ecd-442d-ae08-35d708a9adbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:46.498520 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de5cac2f-2ecd-442d-ae08-35d708a9adbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:46.499068 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de5cac2f-2ecd-442d-ae08-35d708a9adbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:46.499579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de5cac2f-2ecd-442d-ae08-35d708a9adbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:46.633358 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b1b9cbcc-74e0-4bae-8a01-4bfbbd6ea09f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.192787 Aug 17 19:39:46.634194 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 59/113] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 17 19:39:46 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:46.647902 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0450641e-e9af-4fde-ba75-8901a6058482 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:46.648674 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0450641e-e9af-4fde-ba75-8901a6058482 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:46.658285 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0450641e-e9af-4fde-ba75-8901a6058482 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:46.658982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0450641e-e9af-4fde-ba75-8901a6058482 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:46.660401 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0450641e-e9af-4fde-ba75-8901a6058482 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:46.661341 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0450641e-e9af-4fde-ba75-8901a6058482 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:46.662030 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0450641e-e9af-4fde-ba75-8901a6058482 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:46.663355 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0450641e-e9af-4fde-ba75-8901a6058482 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:46.678301 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-de5cac2f-2ecd-442d-ae08-35d708a9adbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:46.687495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-de5cac2f-2ecd-442d-ae08-35d708a9adbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:46.689085 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-de5cac2f-2ecd-442d-ae08-35d708a9adbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:46.690997 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-de5cac2f-2ecd-442d-ae08-35d708a9adbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1406 microversion: 2.20 time: 0.215493 Aug 17 19:39:46.691995 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 55/114] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:46 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:46.818789 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0450641e-e9af-4fde-ba75-8901a6058482 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:46.827453 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0450641e-e9af-4fde-ba75-8901a6058482 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.185111 Aug 17 19:39:46.828026 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 60/115] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:46 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:39:47.516706 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b7af421b-5d16-4e5d-b44f-c22c46c5e5f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:47.517293 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b7af421b-5d16-4e5d-b44f-c22c46c5e5f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:47.532495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b7af421b-5d16-4e5d-b44f-c22c46c5e5f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:47.537888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b7af421b-5d16-4e5d-b44f-c22c46c5e5f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:47.539752 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b7af421b-5d16-4e5d-b44f-c22c46c5e5f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:47.541092 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b7af421b-5d16-4e5d-b44f-c22c46c5e5f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:47.544526 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b7af421b-5d16-4e5d-b44f-c22c46c5e5f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:47.546645 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b7af421b-5d16-4e5d-b44f-c22c46c5e5f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:47.717330 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6df44bd4-222a-48d5-9aba-c94688b445a4 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:47.718588 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6df44bd4-222a-48d5-9aba-c94688b445a4 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:47.729300 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6df44bd4-222a-48d5-9aba-c94688b445a4 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:47.730193 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6df44bd4-222a-48d5-9aba-c94688b445a4 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:47.730854 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6df44bd4-222a-48d5-9aba-c94688b445a4 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:47.732139 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6df44bd4-222a-48d5-9aba-c94688b445a4 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:47.733495 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6df44bd4-222a-48d5-9aba-c94688b445a4 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:47.734127 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6df44bd4-222a-48d5-9aba-c94688b445a4 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:47.753320 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b7af421b-5d16-4e5d-b44f-c22c46c5e5f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:47.760698 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b7af421b-5d16-4e5d-b44f-c22c46c5e5f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1322 microversion: 2.1 time: 0.254095 Aug 17 19:39:47.762143 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 56/116] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:47 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:47.848062 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f590f986-3ff8-4a71-b918-2f05c56b8c66 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:47.848670 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f590f986-3ff8-4a71-b918-2f05c56b8c66 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:47.861492 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f590f986-3ff8-4a71-b918-2f05c56b8c66 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:47.862232 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f590f986-3ff8-4a71-b918-2f05c56b8c66 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:47.862839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f590f986-3ff8-4a71-b918-2f05c56b8c66 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:47.863852 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f590f986-3ff8-4a71-b918-2f05c56b8c66 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:47.880428 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f590f986-3ff8-4a71-b918-2f05c56b8c66 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:47.881588 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f590f986-3ff8-4a71-b918-2f05c56b8c66 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:47.962988 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6df44bd4-222a-48d5-9aba-c94688b445a4 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:47.969293 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=100 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:47.978689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6df44bd4-222a-48d5-9aba-c94688b445a4 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:47.982137 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6df44bd4-222a-48d5-9aba-c94688b445a4 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:47.984443 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6df44bd4-222a-48d5-9aba-c94688b445a4 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1406 microversion: 2.20 time: 0.271234 Aug 17 19:39:47.987711 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 61/117] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:47 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:39:48.143092 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f590f986-3ff8-4a71-b918-2f05c56b8c66 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:48.154719 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f590f986-3ff8-4a71-b918-2f05c56b8c66 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.310527 Aug 17 19:39:48.174418 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 57/118] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:47 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:48.386627 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-a39660a3-951d-4708-885b-249ad89d4138 req-2d297eab-33ae-4352-bfc0-ea16765b9051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0602879a-bbc5-4632-8412-a72ea55b9068", "tag": "6a3e0e5d-86b3-4661-9b06-02498556723f"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:48.400401 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-a39660a3-951d-4708-885b-249ad89d4138 req-2d297eab-33ae-4352-bfc0-ea16765b9051 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:48.400939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-a39660a3-951d-4708-885b-249ad89d4138 req-2d297eab-33ae-4352-bfc0-ea16765b9051 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:48.401576 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-a39660a3-951d-4708-885b-249ad89d4138 req-2d297eab-33ae-4352-bfc0-ea16765b9051 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:48.416103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-a39660a3-951d-4708-885b-249ad89d4138 req-2d297eab-33ae-4352-bfc0-ea16765b9051 service nova] Creating event network-changed:6a3e0e5d-86b3-4661-9b06-02498556723f for instance 0602879a-bbc5-4632-8412-a72ea55b9068 on hv-cinder-85069 Aug 17 19:39:48.422355 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-a39660a3-951d-4708-885b-249ad89d4138 req-2d297eab-33ae-4352-bfc0-ea16765b9051 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041209 Aug 17 19:39:48.423088 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 62/119] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:48.781861 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-675ae3bb-2e40-45d1-9080-d56a5a894475 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:48.783568 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-675ae3bb-2e40-45d1-9080-d56a5a894475 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:48.792211 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-675ae3bb-2e40-45d1-9080-d56a5a894475 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:48.795724 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-675ae3bb-2e40-45d1-9080-d56a5a894475 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:48.796361 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-675ae3bb-2e40-45d1-9080-d56a5a894475 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:48.797318 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-675ae3bb-2e40-45d1-9080-d56a5a894475 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:48.798525 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-675ae3bb-2e40-45d1-9080-d56a5a894475 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:48.799279 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-675ae3bb-2e40-45d1-9080-d56a5a894475 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:49.019276 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b536d092-6648-401f-9eac-a61c75c7182c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:49.020381 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b536d092-6648-401f-9eac-a61c75c7182c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:49.035231 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b536d092-6648-401f-9eac-a61c75c7182c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:49.035826 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b536d092-6648-401f-9eac-a61c75c7182c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:49.036375 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b536d092-6648-401f-9eac-a61c75c7182c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:49.038533 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b536d092-6648-401f-9eac-a61c75c7182c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:49.039029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b536d092-6648-401f-9eac-a61c75c7182c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:49.039455 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b536d092-6648-401f-9eac-a61c75c7182c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:49.050536 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-675ae3bb-2e40-45d1-9080-d56a5a894475 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:49.060296 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-675ae3bb-2e40-45d1-9080-d56a5a894475 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1516 microversion: 2.1 time: 0.283110 Aug 17 19:39:49.062216 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 58/120] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:48 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:49.084967 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f592c0a7-b6b8-4f17-a6ef-c480228cac1c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:49.087787 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f592c0a7-b6b8-4f17-a6ef-c480228cac1c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:49.096023 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f592c0a7-b6b8-4f17-a6ef-c480228cac1c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:49.096771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f592c0a7-b6b8-4f17-a6ef-c480228cac1c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:49.097474 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f592c0a7-b6b8-4f17-a6ef-c480228cac1c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:49.098422 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f592c0a7-b6b8-4f17-a6ef-c480228cac1c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:49.099447 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f592c0a7-b6b8-4f17-a6ef-c480228cac1c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:49.100062 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f592c0a7-b6b8-4f17-a6ef-c480228cac1c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:49.215106 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-f592c0a7-b6b8-4f17-a6ef-c480228cac1c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lazy-loading 'flavor' on Instance uuid 55783dca-99fe-42bc-9e65-2c65038d0902 {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:39:49.302160 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b536d092-6648-401f-9eac-a61c75c7182c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:49.314927 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b536d092-6648-401f-9eac-a61c75c7182c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:49.317010 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b536d092-6648-401f-9eac-a61c75c7182c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:49.318643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b536d092-6648-401f-9eac-a61c75c7182c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1597 microversion: 2.20 time: 0.307884 Aug 17 19:39:49.320277 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 63/121] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:39:49 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1597 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:39:49.326896 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f86ae157-0346-4833-98a1-c0891090cf1c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:49.327701 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f86ae157-0346-4833-98a1-c0891090cf1c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:49.346599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f86ae157-0346-4833-98a1-c0891090cf1c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:49.349802 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f86ae157-0346-4833-98a1-c0891090cf1c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:49.350250 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f86ae157-0346-4833-98a1-c0891090cf1c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:49.351281 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f86ae157-0346-4833-98a1-c0891090cf1c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:49.351809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f86ae157-0346-4833-98a1-c0891090cf1c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:49.352235 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f86ae157-0346-4833-98a1-c0891090cf1c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:49.428414 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f592c0a7-b6b8-4f17-a6ef-c480228cac1c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "POST /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902/action" status: 200 len: 32 microversion: 2.1 time: 0.347359 Aug 17 19:39:49.433359 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 59/122] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:39:49 2022] POST /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902/action => generated 32 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 19:39:49.440880 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-35ed4f44-79d9-4fcb-b705-933fd400d6db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:49.441530 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-35ed4f44-79d9-4fcb-b705-933fd400d6db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:49.450559 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-35ed4f44-79d9-4fcb-b705-933fd400d6db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:49.450559 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-35ed4f44-79d9-4fcb-b705-933fd400d6db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:49.450993 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-35ed4f44-79d9-4fcb-b705-933fd400d6db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:49.451674 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-35ed4f44-79d9-4fcb-b705-933fd400d6db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:49.452080 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-35ed4f44-79d9-4fcb-b705-933fd400d6db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:49.452548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-35ed4f44-79d9-4fcb-b705-933fd400d6db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:49.611895 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-35ed4f44-79d9-4fcb-b705-933fd400d6db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.177088 Aug 17 19:39:49.612639 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 60/123] 10.222.0.59 () {60 vars in 1316 bytes} [Wed Aug 17 19:39:49 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:39:49.617984 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-536d2fe1-ba63-4b85-8469-8df9f2b20fe0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:49.618661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-536d2fe1-ba63-4b85-8469-8df9f2b20fe0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:49.623252 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f86ae157-0346-4833-98a1-c0891090cf1c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:49.635418 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-536d2fe1-ba63-4b85-8469-8df9f2b20fe0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:49.635418 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-536d2fe1-ba63-4b85-8469-8df9f2b20fe0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:49.635418 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-536d2fe1-ba63-4b85-8469-8df9f2b20fe0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:49.635418 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-536d2fe1-ba63-4b85-8469-8df9f2b20fe0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:49.636083 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-536d2fe1-ba63-4b85-8469-8df9f2b20fe0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:49.636576 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-536d2fe1-ba63-4b85-8469-8df9f2b20fe0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:49.659629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f86ae157-0346-4833-98a1-c0891090cf1c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1315 microversion: 2.1 time: 0.335852 Aug 17 19:39:49.675716 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 64/124] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:49 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:49.945005 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-536d2fe1-ba63-4b85-8469-8df9f2b20fe0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:49.957590 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-536d2fe1-ba63-4b85-8469-8df9f2b20fe0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.343829 Aug 17 19:39:49.961898 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 61/125] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:49 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:50.680031 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8991063a-3936-421a-be88-812af98011f5 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:50.681197 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-8991063a-3936-421a-be88-812af98011f5 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:50.703401 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8991063a-3936-421a-be88-812af98011f5 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:50.706105 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8991063a-3936-421a-be88-812af98011f5 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:50.706658 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8991063a-3936-421a-be88-812af98011f5 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:50.709043 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8991063a-3936-421a-be88-812af98011f5 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:50.709656 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8991063a-3936-421a-be88-812af98011f5 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:50.712504 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8991063a-3936-421a-be88-812af98011f5 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:50.982768 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8a40ba9a-37a4-4897-a430-6e8fecc00059 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:50.983381 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-8a40ba9a-37a4-4897-a430-6e8fecc00059 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:51.007904 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8a40ba9a-37a4-4897-a430-6e8fecc00059 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:51.008400 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8a40ba9a-37a4-4897-a430-6e8fecc00059 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:51.008837 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8a40ba9a-37a4-4897-a430-6e8fecc00059 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:51.009651 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8a40ba9a-37a4-4897-a430-6e8fecc00059 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:51.010011 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8a40ba9a-37a4-4897-a430-6e8fecc00059 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:51.017186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8a40ba9a-37a4-4897-a430-6e8fecc00059 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:51.119439 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8991063a-3936-421a-be88-812af98011f5 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:51.128743 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8991063a-3936-421a-be88-812af98011f5 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1503 microversion: 2.1 time: 0.452542 Aug 17 19:39:51.178834 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 65/126] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:50 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1503 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:51.603679 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8a40ba9a-37a4-4897-a430-6e8fecc00059 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:51.612880 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8a40ba9a-37a4-4897-a430-6e8fecc00059 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.634468 Aug 17 19:39:51.617045 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 62/127] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:50 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:51.982770 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-d393e054-d038-4a73-a6b5-bac506068f01 req-54584dca-f6d7-4d4b-b684-bec2b71888e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b04daa67-36a6-4a53-b80a-e90f77348028", "tag": "8692c85c-fc9f-49cd-bff2-6ddd975dd053"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:51.994286 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-d393e054-d038-4a73-a6b5-bac506068f01 req-54584dca-f6d7-4d4b-b684-bec2b71888e5 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:51.994889 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-d393e054-d038-4a73-a6b5-bac506068f01 req-54584dca-f6d7-4d4b-b684-bec2b71888e5 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:51.995480 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-d393e054-d038-4a73-a6b5-bac506068f01 req-54584dca-f6d7-4d4b-b684-bec2b71888e5 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:52.010040 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-d393e054-d038-4a73-a6b5-bac506068f01 req-54584dca-f6d7-4d4b-b684-bec2b71888e5 service nova] Creating event network-changed:8692c85c-fc9f-49cd-bff2-6ddd975dd053 for instance b04daa67-36a6-4a53-b80a-e90f77348028 on hv-cinder-85069 Aug 17 19:39:52.016970 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-d393e054-d038-4a73-a6b5-bac506068f01 req-54584dca-f6d7-4d4b-b684-bec2b71888e5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037613 Aug 17 19:39:52.018122 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 66/128] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:52.640671 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f291eadd-62df-4ab5-a26f-692e8559eba7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:52.642493 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f291eadd-62df-4ab5-a26f-692e8559eba7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:52.652692 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f291eadd-62df-4ab5-a26f-692e8559eba7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:52.653669 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f291eadd-62df-4ab5-a26f-692e8559eba7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:52.655141 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f291eadd-62df-4ab5-a26f-692e8559eba7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:52.656121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f291eadd-62df-4ab5-a26f-692e8559eba7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:52.656899 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f291eadd-62df-4ab5-a26f-692e8559eba7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:52.657560 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f291eadd-62df-4ab5-a26f-692e8559eba7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:52.685343 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:39:52.955075 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f291eadd-62df-4ab5-a26f-692e8559eba7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:52.962200 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f291eadd-62df-4ab5-a26f-692e8559eba7 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.326991 Aug 17 19:39:52.963687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 63/129] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:52 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:53.986049 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-7f9bde2e-ffce-4e71-8a62-b02a744bd4f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:53.987379 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-7f9bde2e-ffce-4e71-8a62-b02a744bd4f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:53.994608 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7f9bde2e-ffce-4e71-8a62-b02a744bd4f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:53.995321 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7f9bde2e-ffce-4e71-8a62-b02a744bd4f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:53.995922 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7f9bde2e-ffce-4e71-8a62-b02a744bd4f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:53.996836 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7f9bde2e-ffce-4e71-8a62-b02a744bd4f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:53.997458 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7f9bde2e-ffce-4e71-8a62-b02a744bd4f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:53.998069 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7f9bde2e-ffce-4e71-8a62-b02a744bd4f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:54.196762 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-7f9bde2e-ffce-4e71-8a62-b02a744bd4f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:54.205779 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-7f9bde2e-ffce-4e71-8a62-b02a744bd4f4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.224336 Aug 17 19:39:54.206558 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 67/130] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:53 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:55.032967 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-568f30f0-75b7-41ec-856a-4384e47a9903 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29b168be-fef5-49da-a286-e8c4eaa21d00"}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:39:55.035375 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-568f30f0-75b7-41ec-856a-4384e47a9903 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:55.041588 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-568f30f0-75b7-41ec-856a-4384e47a9903 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:55.042725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-568f30f0-75b7-41ec-856a-4384e47a9903 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:55.043265 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-568f30f0-75b7-41ec-856a-4384e47a9903 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:55.044308 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-568f30f0-75b7-41ec-856a-4384e47a9903 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:55.045002 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-568f30f0-75b7-41ec-856a-4384e47a9903 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:55.045695 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-568f30f0-75b7-41ec-856a-4384e47a9903 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:55.229240 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-2236eeab-2b9b-47df-86a9-bd8314e3b64e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:55.229887 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-2236eeab-2b9b-47df-86a9-bd8314e3b64e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:55.252851 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2236eeab-2b9b-47df-86a9-bd8314e3b64e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:55.255076 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2236eeab-2b9b-47df-86a9-bd8314e3b64e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:55.256029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2236eeab-2b9b-47df-86a9-bd8314e3b64e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:55.256771 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2236eeab-2b9b-47df-86a9-bd8314e3b64e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:55.257188 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2236eeab-2b9b-47df-86a9-bd8314e3b64e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:55.257644 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2236eeab-2b9b-47df-86a9-bd8314e3b64e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:55.462356 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2236eeab-2b9b-47df-86a9-bd8314e3b64e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:55.473090 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-2236eeab-2b9b-47df-86a9-bd8314e3b64e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.246682 Aug 17 19:39:55.475718 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 68/131] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:55 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:39:55.485145 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-568f30f0-75b7-41ec-856a-4384e47a9903 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "POST /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.456516 Aug 17 19:39:55.486456 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 64/132] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:39:55 2022] POST /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d/os-volume_attachments => generated 194 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:39:56.495761 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3f57bd94-abe8-44ad-9a02-2b61096aa6da tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:56.496378 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3f57bd94-abe8-44ad-9a02-2b61096aa6da tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:56.513440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3f57bd94-abe8-44ad-9a02-2b61096aa6da tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:56.513440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3f57bd94-abe8-44ad-9a02-2b61096aa6da tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:56.513440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3f57bd94-abe8-44ad-9a02-2b61096aa6da tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:56.513440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3f57bd94-abe8-44ad-9a02-2b61096aa6da tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:56.513821 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3f57bd94-abe8-44ad-9a02-2b61096aa6da tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:56.513821 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3f57bd94-abe8-44ad-9a02-2b61096aa6da tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:56.658874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3f57bd94-abe8-44ad-9a02-2b61096aa6da tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:56.666499 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3f57bd94-abe8-44ad-9a02-2b61096aa6da tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.174580 Aug 17 19:39:56.667072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 69/133] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:56 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:57.693588 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e6a89f52-f512-44cc-a339-97509c70efbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:57.696556 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e6a89f52-f512-44cc-a339-97509c70efbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:57.717174 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e6a89f52-f512-44cc-a339-97509c70efbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:57.717714 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e6a89f52-f512-44cc-a339-97509c70efbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:57.718156 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e6a89f52-f512-44cc-a339-97509c70efbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:57.718870 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e6a89f52-f512-44cc-a339-97509c70efbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:57.719324 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e6a89f52-f512-44cc-a339-97509c70efbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:57.719758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e6a89f52-f512-44cc-a339-97509c70efbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:57.897023 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e6a89f52-f512-44cc-a339-97509c70efbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:57.905789 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e6a89f52-f512-44cc-a339-97509c70efbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.218399 Aug 17 19:39:57.906208 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 65/134] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:57 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:39:58.927182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-355d1319-5799-4712-abf7-e61661b506d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:39:58.927871 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-355d1319-5799-4712-abf7-e61661b506d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:39:58.933969 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-355d1319-5799-4712-abf7-e61661b506d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:58.934598 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-355d1319-5799-4712-abf7-e61661b506d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:58.935110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-355d1319-5799-4712-abf7-e61661b506d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:58.937046 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-355d1319-5799-4712-abf7-e61661b506d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:39:58.937519 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-355d1319-5799-4712-abf7-e61661b506d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:39:58.937937 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-355d1319-5799-4712-abf7-e61661b506d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:39:59.082229 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-355d1319-5799-4712-abf7-e61661b506d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:39:59.090728 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-355d1319-5799-4712-abf7-e61661b506d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.167913 Aug 17 19:39:59.091721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 70/135] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:39:58 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:00.111765 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-9f4068b9-2c85-49c6-8b88-fe496a98a5d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:00.112482 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9f4068b9-2c85-49c6-8b88-fe496a98a5d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:00.119166 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9f4068b9-2c85-49c6-8b88-fe496a98a5d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:00.119780 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9f4068b9-2c85-49c6-8b88-fe496a98a5d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:00.120349 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9f4068b9-2c85-49c6-8b88-fe496a98a5d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:00.121134 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9f4068b9-2c85-49c6-8b88-fe496a98a5d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:00.121687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9f4068b9-2c85-49c6-8b88-fe496a98a5d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:00.122318 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9f4068b9-2c85-49c6-8b88-fe496a98a5d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:00.259115 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9f4068b9-2c85-49c6-8b88-fe496a98a5d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:00.267124 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-9f4068b9-2c85-49c6-8b88-fe496a98a5d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.159247 Aug 17 19:40:00.267689 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 66/136] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:00 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:01.287926 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-900dee45-f73e-4af8-9363-1c16cc9f1fcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:01.289048 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-900dee45-f73e-4af8-9363-1c16cc9f1fcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:01.295756 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-900dee45-f73e-4af8-9363-1c16cc9f1fcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:01.296267 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-900dee45-f73e-4af8-9363-1c16cc9f1fcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:01.296870 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-900dee45-f73e-4af8-9363-1c16cc9f1fcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:01.297792 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-900dee45-f73e-4af8-9363-1c16cc9f1fcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:01.298429 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-900dee45-f73e-4af8-9363-1c16cc9f1fcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:01.298859 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-900dee45-f73e-4af8-9363-1c16cc9f1fcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:01.454382 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-900dee45-f73e-4af8-9363-1c16cc9f1fcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:01.454382 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-900dee45-f73e-4af8-9363-1c16cc9f1fcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.169269 Aug 17 19:40:01.454732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 71/137] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:01 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:02.476213 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-fa2af3da-4ce6-4628-adeb-d9f49e8c02ec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:02.476854 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-fa2af3da-4ce6-4628-adeb-d9f49e8c02ec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:02.485700 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa2af3da-4ce6-4628-adeb-d9f49e8c02ec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:02.486185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa2af3da-4ce6-4628-adeb-d9f49e8c02ec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:02.486696 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa2af3da-4ce6-4628-adeb-d9f49e8c02ec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:02.487278 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa2af3da-4ce6-4628-adeb-d9f49e8c02ec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:02.487725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa2af3da-4ce6-4628-adeb-d9f49e8c02ec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:02.488135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa2af3da-4ce6-4628-adeb-d9f49e8c02ec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:02.642093 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-fa2af3da-4ce6-4628-adeb-d9f49e8c02ec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:02.649788 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-fa2af3da-4ce6-4628-adeb-d9f49e8c02ec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.177957 Aug 17 19:40:02.650372 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 67/138] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:02 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:03.670749 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d951c427-dc79-4d8b-bc28-1517bcbb51bb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:03.671354 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d951c427-dc79-4d8b-bc28-1517bcbb51bb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:03.677327 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d951c427-dc79-4d8b-bc28-1517bcbb51bb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:03.677802 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d951c427-dc79-4d8b-bc28-1517bcbb51bb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:03.678234 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d951c427-dc79-4d8b-bc28-1517bcbb51bb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:03.678909 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d951c427-dc79-4d8b-bc28-1517bcbb51bb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:03.679369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d951c427-dc79-4d8b-bc28-1517bcbb51bb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:03.679773 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d951c427-dc79-4d8b-bc28-1517bcbb51bb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:03.803619 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d951c427-dc79-4d8b-bc28-1517bcbb51bb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:03.811766 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d951c427-dc79-4d8b-bc28-1517bcbb51bb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.145193 Aug 17 19:40:03.812462 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 72/139] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:03 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:04.833148 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e75f3fe9-89b2-4c10-9319-bf057dbf7928 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:04.833780 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e75f3fe9-89b2-4c10-9319-bf057dbf7928 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:04.836168 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=74 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:40:04.841931 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e75f3fe9-89b2-4c10-9319-bf057dbf7928 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:04.842426 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e75f3fe9-89b2-4c10-9319-bf057dbf7928 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:04.842866 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e75f3fe9-89b2-4c10-9319-bf057dbf7928 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:04.843561 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e75f3fe9-89b2-4c10-9319-bf057dbf7928 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:04.844038 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e75f3fe9-89b2-4c10-9319-bf057dbf7928 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:04.844445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e75f3fe9-89b2-4c10-9319-bf057dbf7928 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:04.974240 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e75f3fe9-89b2-4c10-9319-bf057dbf7928 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:04.981599 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e75f3fe9-89b2-4c10-9319-bf057dbf7928 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.152338 Aug 17 19:40:04.982666 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 68/140] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:04 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:06.003188 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-26db819b-78bb-4167-b7ac-99c5476e17b4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:06.003972 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-26db819b-78bb-4167-b7ac-99c5476e17b4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:06.006022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=66 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:40:06.011100 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-26db819b-78bb-4167-b7ac-99c5476e17b4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:06.011598 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-26db819b-78bb-4167-b7ac-99c5476e17b4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:06.012015 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-26db819b-78bb-4167-b7ac-99c5476e17b4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:06.012700 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-26db819b-78bb-4167-b7ac-99c5476e17b4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:06.013153 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-26db819b-78bb-4167-b7ac-99c5476e17b4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:06.013603 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-26db819b-78bb-4167-b7ac-99c5476e17b4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:06.141461 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-26db819b-78bb-4167-b7ac-99c5476e17b4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:06.148903 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-26db819b-78bb-4167-b7ac-99c5476e17b4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.150096 Aug 17 19:40:06.150693 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 73/141] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:05 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:07.169446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2c6696d2-e800-47ab-ac67-38c1542628c2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:07.170057 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2c6696d2-e800-47ab-ac67-38c1542628c2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:07.176388 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2c6696d2-e800-47ab-ac67-38c1542628c2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:07.178377 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2c6696d2-e800-47ab-ac67-38c1542628c2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:07.178817 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2c6696d2-e800-47ab-ac67-38c1542628c2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:07.179505 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2c6696d2-e800-47ab-ac67-38c1542628c2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:07.179958 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2c6696d2-e800-47ab-ac67-38c1542628c2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:07.180378 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2c6696d2-e800-47ab-ac67-38c1542628c2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:07.311200 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-2c6696d2-e800-47ab-ac67-38c1542628c2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:07.318629 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2c6696d2-e800-47ab-ac67-38c1542628c2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.153049 Aug 17 19:40:07.319197 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 69/142] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:07 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:08.340159 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-693d5b7c-3ea9-4db7-9933-076feb13555d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:08.340686 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-693d5b7c-3ea9-4db7-9933-076feb13555d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:08.346526 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-693d5b7c-3ea9-4db7-9933-076feb13555d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:08.346995 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-693d5b7c-3ea9-4db7-9933-076feb13555d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:08.347424 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-693d5b7c-3ea9-4db7-9933-076feb13555d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:08.348090 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-693d5b7c-3ea9-4db7-9933-076feb13555d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:08.348534 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-693d5b7c-3ea9-4db7-9933-076feb13555d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:08.348941 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-693d5b7c-3ea9-4db7-9933-076feb13555d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:08.476318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-693d5b7c-3ea9-4db7-9933-076feb13555d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:08.484217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-693d5b7c-3ea9-4db7-9933-076feb13555d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.147897 Aug 17 19:40:08.484780 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 74/143] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:08 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:09.504564 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-9db25f02-3a0f-4cba-8aba-3747c6f201a1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:09.505365 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9db25f02-3a0f-4cba-8aba-3747c6f201a1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:09.512109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9db25f02-3a0f-4cba-8aba-3747c6f201a1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:09.512598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9db25f02-3a0f-4cba-8aba-3747c6f201a1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:09.513033 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9db25f02-3a0f-4cba-8aba-3747c6f201a1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:09.513805 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9db25f02-3a0f-4cba-8aba-3747c6f201a1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:09.514292 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9db25f02-3a0f-4cba-8aba-3747c6f201a1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:09.515262 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9db25f02-3a0f-4cba-8aba-3747c6f201a1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:09.647652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9db25f02-3a0f-4cba-8aba-3747c6f201a1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:09.655277 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-9db25f02-3a0f-4cba-8aba-3747c6f201a1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.154712 Aug 17 19:40:09.655843 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 70/144] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:09 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:10.517404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-299a32a2-7079-4577-b876-196aa0dffab3 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:10.517948 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-299a32a2-7079-4577-b876-196aa0dffab3 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:10.524736 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-299a32a2-7079-4577-b876-196aa0dffab3 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:10.525236 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-299a32a2-7079-4577-b876-196aa0dffab3 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:10.525670 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-299a32a2-7079-4577-b876-196aa0dffab3 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:10.526356 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-299a32a2-7079-4577-b876-196aa0dffab3 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:10.526811 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-299a32a2-7079-4577-b876-196aa0dffab3 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:10.527228 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-299a32a2-7079-4577-b876-196aa0dffab3 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:10.555125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-299a32a2-7079-4577-b876-196aa0dffab3 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:40:10.646856 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-299a32a2-7079-4577-b876-196aa0dffab3 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 204 len: 0 microversion: 2.1 time: 0.132964 Aug 17 19:40:10.647738 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 75/145] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:40:10 2022] DELETE /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:40:10.656431 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f92597c7-47a1-4bf7-accc-82ddf4bf2eee tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:10.657316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f92597c7-47a1-4bf7-accc-82ddf4bf2eee tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:10.663913 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f92597c7-47a1-4bf7-accc-82ddf4bf2eee tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:10.664402 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f92597c7-47a1-4bf7-accc-82ddf4bf2eee tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:10.664844 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f92597c7-47a1-4bf7-accc-82ddf4bf2eee tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:10.665584 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f92597c7-47a1-4bf7-accc-82ddf4bf2eee tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:10.666039 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f92597c7-47a1-4bf7-accc-82ddf4bf2eee tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:10.666463 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f92597c7-47a1-4bf7-accc-82ddf4bf2eee tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:10.678128 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e49e5148-bbd8-4501-96e6-2174dcb74bd5 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:10.679228 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e49e5148-bbd8-4501-96e6-2174dcb74bd5 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:10.686776 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e49e5148-bbd8-4501-96e6-2174dcb74bd5 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:10.687160 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e49e5148-bbd8-4501-96e6-2174dcb74bd5 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:10.687601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e49e5148-bbd8-4501-96e6-2174dcb74bd5 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:10.688335 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e49e5148-bbd8-4501-96e6-2174dcb74bd5 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:10.688794 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e49e5148-bbd8-4501-96e6-2174dcb74bd5 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:10.689546 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e49e5148-bbd8-4501-96e6-2174dcb74bd5 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:10.887230 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f92597c7-47a1-4bf7-accc-82ddf4bf2eee tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:10.898046 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f92597c7-47a1-4bf7-accc-82ddf4bf2eee tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1555 microversion: 2.1 time: 0.245971 Aug 17 19:40:10.898840 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 71/146] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:10 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1555 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:10.914364 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e49e5148-bbd8-4501-96e6-2174dcb74bd5 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:10.922090 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e49e5148-bbd8-4501-96e6-2174dcb74bd5 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.248567 Aug 17 19:40:10.922898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 76/147] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:10 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:11.922094 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1684770b-e5c4-4e2b-a19d-1609411a2a36 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:11.922719 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1684770b-e5c4-4e2b-a19d-1609411a2a36 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:11.930127 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1684770b-e5c4-4e2b-a19d-1609411a2a36 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:11.930698 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1684770b-e5c4-4e2b-a19d-1609411a2a36 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:11.931206 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1684770b-e5c4-4e2b-a19d-1609411a2a36 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:11.932148 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1684770b-e5c4-4e2b-a19d-1609411a2a36 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:11.932677 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1684770b-e5c4-4e2b-a19d-1609411a2a36 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:11.933171 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1684770b-e5c4-4e2b-a19d-1609411a2a36 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:11.947776 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ac00b828-2a48-42e8-8318-45da54f857b6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:11.955582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ac00b828-2a48-42e8-8318-45da54f857b6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:11.965165 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ac00b828-2a48-42e8-8318-45da54f857b6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:11.966255 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ac00b828-2a48-42e8-8318-45da54f857b6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:11.966887 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ac00b828-2a48-42e8-8318-45da54f857b6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:11.968513 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ac00b828-2a48-42e8-8318-45da54f857b6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:11.969050 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ac00b828-2a48-42e8-8318-45da54f857b6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:11.969562 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ac00b828-2a48-42e8-8318-45da54f857b6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:12.132760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1684770b-e5c4-4e2b-a19d-1609411a2a36 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:12.143699 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1684770b-e5c4-4e2b-a19d-1609411a2a36 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1555 microversion: 2.1 time: 0.227507 Aug 17 19:40:12.159340 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 72/148] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:11 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1555 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:12.167480 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-ac00b828-2a48-42e8-8318-45da54f857b6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:12.183011 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ac00b828-2a48-42e8-8318-45da54f857b6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.242379 Aug 17 19:40:12.193983 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 77/149] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:11 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:13.180933 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-55347767-9dc1-4237-8e8c-a260f678053c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:13.182757 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-55347767-9dc1-4237-8e8c-a260f678053c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:13.190606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-55347767-9dc1-4237-8e8c-a260f678053c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:13.191169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-55347767-9dc1-4237-8e8c-a260f678053c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:13.191967 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-55347767-9dc1-4237-8e8c-a260f678053c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:13.193458 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-55347767-9dc1-4237-8e8c-a260f678053c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:13.194451 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-55347767-9dc1-4237-8e8c-a260f678053c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:13.195058 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-55347767-9dc1-4237-8e8c-a260f678053c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:13.204535 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d424eeff-fcae-45c2-8af6-93c9443b21e1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:13.205136 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d424eeff-fcae-45c2-8af6-93c9443b21e1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:13.221616 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d424eeff-fcae-45c2-8af6-93c9443b21e1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:13.222106 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d424eeff-fcae-45c2-8af6-93c9443b21e1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:13.222533 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d424eeff-fcae-45c2-8af6-93c9443b21e1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:13.223374 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d424eeff-fcae-45c2-8af6-93c9443b21e1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:13.223901 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d424eeff-fcae-45c2-8af6-93c9443b21e1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:13.224631 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d424eeff-fcae-45c2-8af6-93c9443b21e1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:13.233978 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:40:13.476430 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-55347767-9dc1-4237-8e8c-a260f678053c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:13.486221 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-55347767-9dc1-4237-8e8c-a260f678053c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1555 microversion: 2.1 time: 0.309391 Aug 17 19:40:13.486878 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 73/150] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:13 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1555 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:13.506344 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d424eeff-fcae-45c2-8af6-93c9443b21e1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:13.514651 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d424eeff-fcae-45c2-8af6-93c9443b21e1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.314420 Aug 17 19:40:13.515101 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 78/151] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:13 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:14.262714 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-c356c8b1-a079-437a-a4e4-76cd566ec3b5 req-b8f97935-253d-44da-8fa0-18677fd55792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e75fe34-cc76-4a62-b545-c2419fc4789d", "name": "network-vif-deleted", "tag": "a76528d3-da4d-4b10-9dcb-381d2ede6e64"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:40:14.274856 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-c356c8b1-a079-437a-a4e4-76cd566ec3b5 req-b8f97935-253d-44da-8fa0-18677fd55792 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:14.275571 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-c356c8b1-a079-437a-a4e4-76cd566ec3b5 req-b8f97935-253d-44da-8fa0-18677fd55792 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:14.276337 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-c356c8b1-a079-437a-a4e4-76cd566ec3b5 req-b8f97935-253d-44da-8fa0-18677fd55792 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:14.290358 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-c356c8b1-a079-437a-a4e4-76cd566ec3b5 req-b8f97935-253d-44da-8fa0-18677fd55792 service nova] Creating event network-vif-deleted:a76528d3-da4d-4b10-9dcb-381d2ede6e64 for instance 9e75fe34-cc76-4a62-b545-c2419fc4789d on hv-cinder-85069 Aug 17 19:40:14.297580 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-c356c8b1-a079-437a-a4e4-76cd566ec3b5 req-b8f97935-253d-44da-8fa0-18677fd55792 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038971 Aug 17 19:40:14.298644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 74/152] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:40:14.508128 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-32c69d22-3ed1-473d-a971-1a0e05319a5c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:14.509418 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-32c69d22-3ed1-473d-a971-1a0e05319a5c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:14.517239 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-32c69d22-3ed1-473d-a971-1a0e05319a5c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:14.517738 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-32c69d22-3ed1-473d-a971-1a0e05319a5c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:14.518409 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-32c69d22-3ed1-473d-a971-1a0e05319a5c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:14.519170 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-32c69d22-3ed1-473d-a971-1a0e05319a5c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:14.519724 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-32c69d22-3ed1-473d-a971-1a0e05319a5c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:14.520351 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-32c69d22-3ed1-473d-a971-1a0e05319a5c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:14.545816 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f164050d-98b6-4d45-812e-7997a05d1112 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:14.546514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f164050d-98b6-4d45-812e-7997a05d1112 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:14.552963 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f164050d-98b6-4d45-812e-7997a05d1112 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:14.553655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f164050d-98b6-4d45-812e-7997a05d1112 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:14.554246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f164050d-98b6-4d45-812e-7997a05d1112 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:14.555090 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f164050d-98b6-4d45-812e-7997a05d1112 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:14.555704 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f164050d-98b6-4d45-812e-7997a05d1112 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:14.556273 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f164050d-98b6-4d45-812e-7997a05d1112 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:14.631130 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-32c69d22-3ed1-473d-a971-1a0e05319a5c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bda1e1b7cfb44577bf7063f2e09f6791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adff2535a66d443baa9ddc4b5bde9ef2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:14.642762 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-32c69d22-3ed1-473d-a971-1a0e05319a5c tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 200 len: 1346 microversion: 2.1 time: 0.138861 Aug 17 19:40:14.657972 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 79/153] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:14 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 1346 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:14.769559 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f164050d-98b6-4d45-812e-7997a05d1112 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:14.777906 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f164050d-98b6-4d45-812e-7997a05d1112 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.236413 Aug 17 19:40:14.802718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 75/154] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:14 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:15.664091 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-946bd0ad-7229-4ffa-bd70-88ddcb7b536e tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:15.664759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-946bd0ad-7229-4ffa-bd70-88ddcb7b536e tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:15.671323 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-946bd0ad-7229-4ffa-bd70-88ddcb7b536e tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:15.671861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-946bd0ad-7229-4ffa-bd70-88ddcb7b536e tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:15.672355 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-946bd0ad-7229-4ffa-bd70-88ddcb7b536e tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:15.672991 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-946bd0ad-7229-4ffa-bd70-88ddcb7b536e tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:15.673473 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-946bd0ad-7229-4ffa-bd70-88ddcb7b536e tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:15.677659 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-946bd0ad-7229-4ffa-bd70-88ddcb7b536e tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:15.703003 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-946bd0ad-7229-4ffa-bd70-88ddcb7b536e tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] HTTP exception thrown: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-946bd0ad-7229-4ffa-bd70-88ddcb7b536e tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Request method failure captured: Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d HTTP/1.1 Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPe1oL1WMHGX9kB9Pmj_6JzCj_ZWmzysYZchioUCmiseey7onBmxsKCrVZ8Sz73pxhe8piuoKJe8hrBHqTlYBDmiEXDmefHdEnidr9RyeVZq9E6PbKtmhEd1I4fEn0T1Nml8QjGtfoe9h08DoJdo-iJ7R7BVwEDMyFVXQp4QFn--JE Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: adff2535a66d443baa9ddc4b5bde9ef2 Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-DeleteServersTestJSON-926918665 Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:40:15.707607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:40:15.708880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/adff2535a66d443baa9ddc4b5bde9ef2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/adff2535a66d443baa9ddc4b5bde9ef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_adff2535a66d443baa9ddc4b5bde9ef2", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/adff2535a66d443baa9ddc4b5bde9ef2"}]}] Aug 17 19:40:15.708880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-DeleteServersTestJSON-926918665 Aug 17 19:40:15.708880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: adff2535a66d443baa9ddc4b5bde9ef2 Aug 17 19:40:15.708880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-DeleteServersTestJSON-926918665 Aug 17 19:40:15.708880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-DeleteServersTestJSON-926918665-project Aug 17 19:40:15.708880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:40:15.708880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:40:15.708880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: bda1e1b7cfb44577bf7063f2e09f6791 Aug 17 19:40:15.708880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-DeleteServersTestJSON-926918665-project Aug 17 19:40:15.708880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:40:15.708880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:15.708880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '9e75fe34-cc76-4a62-b545-c2419fc4789d'} Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:40:15.709609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:15.710791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:40:15.712530 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-946bd0ad-7229-4ffa-bd70-88ddcb7b536e tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Returning 404 to user: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:40:15.712530 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-946bd0ad-7229-4ffa-bd70-88ddcb7b536e tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 404 len: 111 microversion: 2.1 time: 0.049109 Aug 17 19:40:15.712836 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 80/155] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:15 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 19:40:15.805719 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5d753f77-042d-4e6d-920d-4d3c0fbbf022 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:15.806342 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5d753f77-042d-4e6d-920d-4d3c0fbbf022 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:15.816236 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d753f77-042d-4e6d-920d-4d3c0fbbf022 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:15.816725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d753f77-042d-4e6d-920d-4d3c0fbbf022 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:15.817164 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d753f77-042d-4e6d-920d-4d3c0fbbf022 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:15.817897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d753f77-042d-4e6d-920d-4d3c0fbbf022 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:15.818530 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d753f77-042d-4e6d-920d-4d3c0fbbf022 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:15.819174 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d753f77-042d-4e6d-920d-4d3c0fbbf022 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:15.876306 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-803f95a8-67c4-4593-b888-e83001e38410 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:15.878836 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-803f95a8-67c4-4593-b888-e83001e38410 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:15.886023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-803f95a8-67c4-4593-b888-e83001e38410 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:15.886507 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-803f95a8-67c4-4593-b888-e83001e38410 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:15.887070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-803f95a8-67c4-4593-b888-e83001e38410 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:15.887918 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-803f95a8-67c4-4593-b888-e83001e38410 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:15.888572 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-803f95a8-67c4-4593-b888-e83001e38410 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:15.889957 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-803f95a8-67c4-4593-b888-e83001e38410 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:15.903984 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-803f95a8-67c4-4593-b888-e83001e38410 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] HTTP exception thrown: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-803f95a8-67c4-4593-b888-e83001e38410 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Request method failure captured: Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d/os-volume_attachments HTTP/1.1 Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPe1oL1WMHGX9kB9Pmj_6JzCj_ZWmzysYZchioUCmiseey7onBmxsKCrVZ8Sz73pxhe8piuoKJe8hrBHqTlYBDmiEXDmefHdEnidr9RyeVZq9E6PbKtmhEd1I4fEn0T1Nml8QjGtfoe9h08DoJdo-iJ7R7BVwEDMyFVXQp4QFn--JE Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: adff2535a66d443baa9ddc4b5bde9ef2 Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-DeleteServersTestJSON-926918665 Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:40:15.906809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:40:15.907989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/adff2535a66d443baa9ddc4b5bde9ef2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/adff2535a66d443baa9ddc4b5bde9ef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_adff2535a66d443baa9ddc4b5bde9ef2", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/adff2535a66d443baa9ddc4b5bde9ef2"}]}] Aug 17 19:40:15.907989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-DeleteServersTestJSON-926918665 Aug 17 19:40:15.907989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: adff2535a66d443baa9ddc4b5bde9ef2 Aug 17 19:40:15.907989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-DeleteServersTestJSON-926918665 Aug 17 19:40:15.907989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-DeleteServersTestJSON-926918665-project Aug 17 19:40:15.907989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:40:15.907989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:40:15.907989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: bda1e1b7cfb44577bf7063f2e09f6791 Aug 17 19:40:15.907989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-DeleteServersTestJSON-926918665-project Aug 17 19:40:15.907989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:40:15.907989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:15.907989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'server_id': '9e75fe34-cc76-4a62-b545-c2419fc4789d'} Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:40:15.908648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:15.909698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:40:15.919600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-803f95a8-67c4-4593-b888-e83001e38410 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Returning 404 to user: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:40:15.920742 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-803f95a8-67c4-4593-b888-e83001e38410 tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048927 Aug 17 19:40:15.924646 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 81/156] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:40:15 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:40:16.056631 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5d753f77-042d-4e6d-920d-4d3c0fbbf022 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:16.074796 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5d753f77-042d-4e6d-920d-4d3c0fbbf022 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.275321 Aug 17 19:40:16.076298 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 76/157] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:15 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:17.101004 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-12979c92-c971-422a-a4b6-902d60f96ca9 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:17.101637 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-12979c92-c971-422a-a4b6-902d60f96ca9 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:17.108665 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12979c92-c971-422a-a4b6-902d60f96ca9 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:17.109185 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12979c92-c971-422a-a4b6-902d60f96ca9 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:17.109652 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12979c92-c971-422a-a4b6-902d60f96ca9 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:17.110338 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12979c92-c971-422a-a4b6-902d60f96ca9 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:17.110786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12979c92-c971-422a-a4b6-902d60f96ca9 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:17.111202 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12979c92-c971-422a-a4b6-902d60f96ca9 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:17.233841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6a065c9e-1eb1-4258-9cb6-9a1ef977c97d tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:17.234619 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-6a065c9e-1eb1-4258-9cb6-9a1ef977c97d tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:17.242989 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6a065c9e-1eb1-4258-9cb6-9a1ef977c97d tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:17.246348 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6a065c9e-1eb1-4258-9cb6-9a1ef977c97d tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:17.248159 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6a065c9e-1eb1-4258-9cb6-9a1ef977c97d tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:17.252473 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6a065c9e-1eb1-4258-9cb6-9a1ef977c97d tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:17.253068 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6a065c9e-1eb1-4258-9cb6-9a1ef977c97d tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:17.253610 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6a065c9e-1eb1-4258-9cb6-9a1ef977c97d tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:17.269003 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-6a065c9e-1eb1-4258-9cb6-9a1ef977c97d tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] HTTP exception thrown: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:17.272779 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-12979c92-c971-422a-a4b6-902d60f96ca9 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6a065c9e-1eb1-4258-9cb6-9a1ef977c97d tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Request method failure captured: Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: DELETE /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d HTTP/1.1 Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPe1oL1WMHGX9kB9Pmj_6JzCj_ZWmzysYZchioUCmiseey7onBmxsKCrVZ8Sz73pxhe8piuoKJe8hrBHqTlYBDmiEXDmefHdEnidr9RyeVZq9E6PbKtmhEd1I4fEn0T1Nml8QjGtfoe9h08DoJdo-iJ7R7BVwEDMyFVXQp4QFn--JE Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: adff2535a66d443baa9ddc4b5bde9ef2 Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-DeleteServersTestJSON-926918665 Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:40:17.277547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:40:17.279212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/adff2535a66d443baa9ddc4b5bde9ef2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/adff2535a66d443baa9ddc4b5bde9ef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_adff2535a66d443baa9ddc4b5bde9ef2", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/adff2535a66d443baa9ddc4b5bde9ef2"}]}] Aug 17 19:40:17.279212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-DeleteServersTestJSON-926918665 Aug 17 19:40:17.279212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: adff2535a66d443baa9ddc4b5bde9ef2 Aug 17 19:40:17.279212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-DeleteServersTestJSON-926918665 Aug 17 19:40:17.279212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-DeleteServersTestJSON-926918665-project Aug 17 19:40:17.279212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:40:17.279212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:40:17.279212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: bda1e1b7cfb44577bf7063f2e09f6791 Aug 17 19:40:17.279212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-DeleteServersTestJSON-926918665-project Aug 17 19:40:17.279212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:40:17.279212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:17.279212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '9e75fe34-cc76-4a62-b545-c2419fc4789d'} Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:40:17.280946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:17.282770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:40:17.285426 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6a065c9e-1eb1-4258-9cb6-9a1ef977c97d tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Returning 404 to user: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:40:17.285426 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-6a065c9e-1eb1-4258-9cb6-9a1ef977c97d tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 404 len: 111 microversion: 2.1 time: 0.051605 Aug 17 19:40:17.285426 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 77/158] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:40:17 2022] DELETE /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 19:40:17.294030 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4784fb05-b49b-489c-9f34-6c6a3961ffda tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:17.294915 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4784fb05-b49b-489c-9f34-6c6a3961ffda tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] [instance: 9e75fe34-cc76-4a62-b545-c2419fc4789d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:17.299378 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-12979c92-c971-422a-a4b6-902d60f96ca9 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.202142 Aug 17 19:40:17.301507 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 82/159] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:17 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:17.301725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4784fb05-b49b-489c-9f34-6c6a3961ffda tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:17.302390 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4784fb05-b49b-489c-9f34-6c6a3961ffda tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:17.302829 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4784fb05-b49b-489c-9f34-6c6a3961ffda tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:17.303530 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4784fb05-b49b-489c-9f34-6c6a3961ffda tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:17.303983 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4784fb05-b49b-489c-9f34-6c6a3961ffda tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:17.304404 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4784fb05-b49b-489c-9f34-6c6a3961ffda tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:17.320515 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-4784fb05-b49b-489c-9f34-6c6a3961ffda tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] HTTP exception thrown: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4784fb05-b49b-489c-9f34-6c6a3961ffda tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Request method failure captured: Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d HTTP/1.1 Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPe1oL1WMHGX9kB9Pmj_6JzCj_ZWmzysYZchioUCmiseey7onBmxsKCrVZ8Sz73pxhe8piuoKJe8hrBHqTlYBDmiEXDmefHdEnidr9RyeVZq9E6PbKtmhEd1I4fEn0T1Nml8QjGtfoe9h08DoJdo-iJ7R7BVwEDMyFVXQp4QFn--JE Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: adff2535a66d443baa9ddc4b5bde9ef2 Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-DeleteServersTestJSON-926918665 Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:40:17.322487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:40:17.323912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/adff2535a66d443baa9ddc4b5bde9ef2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/adff2535a66d443baa9ddc4b5bde9ef2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_adff2535a66d443baa9ddc4b5bde9ef2", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/adff2535a66d443baa9ddc4b5bde9ef2"}]}] Aug 17 19:40:17.323912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-DeleteServersTestJSON-926918665 Aug 17 19:40:17.323912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: adff2535a66d443baa9ddc4b5bde9ef2 Aug 17 19:40:17.323912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-DeleteServersTestJSON-926918665 Aug 17 19:40:17.323912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-DeleteServersTestJSON-926918665-project Aug 17 19:40:17.323912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:40:17.323912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:40:17.323912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: bda1e1b7cfb44577bf7063f2e09f6791 Aug 17 19:40:17.323912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-DeleteServersTestJSON-926918665-project Aug 17 19:40:17.323912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:40:17.323912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:17.323912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '9e75fe34-cc76-4a62-b545-c2419fc4789d'} Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:40:17.325052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. Aug 17 19:40:17.326562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:40:17.327486 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4784fb05-b49b-489c-9f34-6c6a3961ffda tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] Returning 404 to user: Instance 9e75fe34-cc76-4a62-b545-c2419fc4789d could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:40:17.328498 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4784fb05-b49b-489c-9f34-6c6a3961ffda tempest-DeleteServersTestJSON-926918665 tempest-DeleteServersTestJSON-926918665-project] 10.222.0.59 "GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d" status: 404 len: 111 microversion: 2.1 time: 0.039604 Aug 17 19:40:17.329081 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 78/160] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:17 2022] GET /compute/v2.1/servers/9e75fe34-cc76-4a62-b545-c2419fc4789d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:40:18.322747 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-be162643-fcfc-4b1b-81fc-b4f68c8dfc8f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:18.324045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-be162643-fcfc-4b1b-81fc-b4f68c8dfc8f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:18.338668 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be162643-fcfc-4b1b-81fc-b4f68c8dfc8f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:18.339097 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be162643-fcfc-4b1b-81fc-b4f68c8dfc8f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:18.339525 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be162643-fcfc-4b1b-81fc-b4f68c8dfc8f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:18.340322 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be162643-fcfc-4b1b-81fc-b4f68c8dfc8f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:18.341118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be162643-fcfc-4b1b-81fc-b4f68c8dfc8f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:18.341579 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be162643-fcfc-4b1b-81fc-b4f68c8dfc8f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:18.535543 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-be162643-fcfc-4b1b-81fc-b4f68c8dfc8f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:18.547643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-be162643-fcfc-4b1b-81fc-b4f68c8dfc8f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.230258 Aug 17 19:40:18.548470 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 83/161] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:18 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:19.570254 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-0df8b9f7-f0ef-4ffe-8e25-6f81e09b37c1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:19.570936 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-0df8b9f7-f0ef-4ffe-8e25-6f81e09b37c1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:19.582084 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0df8b9f7-f0ef-4ffe-8e25-6f81e09b37c1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:19.584935 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0df8b9f7-f0ef-4ffe-8e25-6f81e09b37c1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:19.585590 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0df8b9f7-f0ef-4ffe-8e25-6f81e09b37c1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:19.586523 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0df8b9f7-f0ef-4ffe-8e25-6f81e09b37c1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:19.587966 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0df8b9f7-f0ef-4ffe-8e25-6f81e09b37c1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:19.589723 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0df8b9f7-f0ef-4ffe-8e25-6f81e09b37c1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:19.805956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0df8b9f7-f0ef-4ffe-8e25-6f81e09b37c1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:19.814495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-0df8b9f7-f0ef-4ffe-8e25-6f81e09b37c1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.248988 Aug 17 19:40:19.815691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 79/162] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:19 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:20.836781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-937e4668-31ef-4e94-9ef8-7c2826dbd4aa tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:20.837896 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-937e4668-31ef-4e94-9ef8-7c2826dbd4aa tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:20.844796 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-937e4668-31ef-4e94-9ef8-7c2826dbd4aa tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:20.845928 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-937e4668-31ef-4e94-9ef8-7c2826dbd4aa tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:20.846619 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-937e4668-31ef-4e94-9ef8-7c2826dbd4aa tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:20.847550 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-937e4668-31ef-4e94-9ef8-7c2826dbd4aa tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:20.848436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-937e4668-31ef-4e94-9ef8-7c2826dbd4aa tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:20.849096 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-937e4668-31ef-4e94-9ef8-7c2826dbd4aa tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:21.128700 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-937e4668-31ef-4e94-9ef8-7c2826dbd4aa tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:21.138667 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-937e4668-31ef-4e94-9ef8-7c2826dbd4aa tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.305945 Aug 17 19:40:21.155067 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 84/163] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:20 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:22.161788 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-18d6f8de-6c93-40b2-98b0-c70b46ab62d4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:22.163763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-18d6f8de-6c93-40b2-98b0-c70b46ab62d4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:22.172622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-18d6f8de-6c93-40b2-98b0-c70b46ab62d4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:22.173117 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-18d6f8de-6c93-40b2-98b0-c70b46ab62d4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:22.173579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-18d6f8de-6c93-40b2-98b0-c70b46ab62d4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:22.174286 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-18d6f8de-6c93-40b2-98b0-c70b46ab62d4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:22.174744 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-18d6f8de-6c93-40b2-98b0-c70b46ab62d4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:22.175494 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-18d6f8de-6c93-40b2-98b0-c70b46ab62d4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:22.340619 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-18d6f8de-6c93-40b2-98b0-c70b46ab62d4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:22.343555 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:40:22.350299 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-18d6f8de-6c93-40b2-98b0-c70b46ab62d4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.193636 Aug 17 19:40:22.351062 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 80/164] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:22 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:23.371371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8fa4abb7-9629-4333-95b4-aaa411d73ebe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:23.372558 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-8fa4abb7-9629-4333-95b4-aaa411d73ebe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:23.379317 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8fa4abb7-9629-4333-95b4-aaa411d73ebe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:23.379991 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8fa4abb7-9629-4333-95b4-aaa411d73ebe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:23.380863 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8fa4abb7-9629-4333-95b4-aaa411d73ebe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:23.381901 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8fa4abb7-9629-4333-95b4-aaa411d73ebe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:23.382615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8fa4abb7-9629-4333-95b4-aaa411d73ebe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:23.383467 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8fa4abb7-9629-4333-95b4-aaa411d73ebe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:23.626303 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8fa4abb7-9629-4333-95b4-aaa411d73ebe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:23.639755 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8fa4abb7-9629-4333-95b4-aaa411d73ebe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.271625 Aug 17 19:40:23.656834 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 85/165] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:23 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:24.665593 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d226dadb-019d-4341-895a-499aaabc389f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:24.666683 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d226dadb-019d-4341-895a-499aaabc389f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:24.678689 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d226dadb-019d-4341-895a-499aaabc389f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:24.680178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d226dadb-019d-4341-895a-499aaabc389f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:24.683941 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d226dadb-019d-4341-895a-499aaabc389f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:24.684850 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d226dadb-019d-4341-895a-499aaabc389f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:24.685966 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d226dadb-019d-4341-895a-499aaabc389f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:24.687502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d226dadb-019d-4341-895a-499aaabc389f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:24.896755 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d226dadb-019d-4341-895a-499aaabc389f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:24.906996 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d226dadb-019d-4341-895a-499aaabc389f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.246978 Aug 17 19:40:24.908186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 81/166] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:24 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:25.934234 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-913ab867-f75a-42e8-ac50-635e0c58f97a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:25.936229 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-913ab867-f75a-42e8-ac50-635e0c58f97a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:25.942283 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-913ab867-f75a-42e8-ac50-635e0c58f97a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:25.944099 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-913ab867-f75a-42e8-ac50-635e0c58f97a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:25.944746 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-913ab867-f75a-42e8-ac50-635e0c58f97a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:25.945719 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-913ab867-f75a-42e8-ac50-635e0c58f97a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:25.946231 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-913ab867-f75a-42e8-ac50-635e0c58f97a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:25.947525 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-913ab867-f75a-42e8-ac50-635e0c58f97a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:26.101631 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-913ab867-f75a-42e8-ac50-635e0c58f97a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:26.111196 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-913ab867-f75a-42e8-ac50-635e0c58f97a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.181790 Aug 17 19:40:26.111913 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 86/167] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:25 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:27.132601 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e81a7692-73ae-45e3-966d-35f879d7c6a8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:27.133159 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e81a7692-73ae-45e3-966d-35f879d7c6a8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:27.139886 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e81a7692-73ae-45e3-966d-35f879d7c6a8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:27.140692 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e81a7692-73ae-45e3-966d-35f879d7c6a8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:27.141483 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e81a7692-73ae-45e3-966d-35f879d7c6a8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:27.142245 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e81a7692-73ae-45e3-966d-35f879d7c6a8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:27.142884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e81a7692-73ae-45e3-966d-35f879d7c6a8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:27.143720 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e81a7692-73ae-45e3-966d-35f879d7c6a8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:27.344058 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e81a7692-73ae-45e3-966d-35f879d7c6a8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:27.353431 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e81a7692-73ae-45e3-966d-35f879d7c6a8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.224759 Aug 17 19:40:27.354382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 82/168] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:27 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:28.383740 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9e168694-c872-477d-9216-a1b79881d08b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:28.384959 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9e168694-c872-477d-9216-a1b79881d08b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:28.396749 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9e168694-c872-477d-9216-a1b79881d08b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:28.397499 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9e168694-c872-477d-9216-a1b79881d08b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:28.399852 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9e168694-c872-477d-9216-a1b79881d08b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:28.402675 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9e168694-c872-477d-9216-a1b79881d08b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:28.404454 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9e168694-c872-477d-9216-a1b79881d08b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:28.405082 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9e168694-c872-477d-9216-a1b79881d08b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:28.778063 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9e168694-c872-477d-9216-a1b79881d08b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:28.788487 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9e168694-c872-477d-9216-a1b79881d08b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.409769 Aug 17 19:40:28.789077 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 87/169] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:28 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:29.812260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f9e971d7-a780-4454-bfdc-9fd5e272526e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:29.813275 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f9e971d7-a780-4454-bfdc-9fd5e272526e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:29.821851 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f9e971d7-a780-4454-bfdc-9fd5e272526e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:29.822788 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f9e971d7-a780-4454-bfdc-9fd5e272526e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:29.823585 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f9e971d7-a780-4454-bfdc-9fd5e272526e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:29.824634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f9e971d7-a780-4454-bfdc-9fd5e272526e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:29.825387 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f9e971d7-a780-4454-bfdc-9fd5e272526e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:29.827049 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f9e971d7-a780-4454-bfdc-9fd5e272526e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:30.286223 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f9e971d7-a780-4454-bfdc-9fd5e272526e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:30.301141 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f9e971d7-a780-4454-bfdc-9fd5e272526e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.492790 Aug 17 19:40:30.305425 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 83/170] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:29 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:31.328576 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a00864d2-3295-424a-bfb1-f124f3a6544b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:31.329255 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a00864d2-3295-424a-bfb1-f124f3a6544b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:31.338252 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a00864d2-3295-424a-bfb1-f124f3a6544b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:31.338747 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a00864d2-3295-424a-bfb1-f124f3a6544b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:31.339186 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a00864d2-3295-424a-bfb1-f124f3a6544b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:31.343430 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a00864d2-3295-424a-bfb1-f124f3a6544b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:31.343894 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a00864d2-3295-424a-bfb1-f124f3a6544b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:31.344315 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a00864d2-3295-424a-bfb1-f124f3a6544b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:31.663559 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a00864d2-3295-424a-bfb1-f124f3a6544b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:31.672360 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a00864d2-3295-424a-bfb1-f124f3a6544b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1522 microversion: 2.1 time: 0.348493 Aug 17 19:40:31.686666 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 88/171] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:31 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:32.695274 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d10a0994-b805-4aa6-8548-f7c701adb301 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:32.695896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d10a0994-b805-4aa6-8548-f7c701adb301 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:32.710480 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d10a0994-b805-4aa6-8548-f7c701adb301 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:32.711011 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d10a0994-b805-4aa6-8548-f7c701adb301 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:32.711451 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d10a0994-b805-4aa6-8548-f7c701adb301 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:32.717438 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d10a0994-b805-4aa6-8548-f7c701adb301 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:32.717937 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d10a0994-b805-4aa6-8548-f7c701adb301 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:32.718372 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d10a0994-b805-4aa6-8548-f7c701adb301 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:33.059570 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d10a0994-b805-4aa6-8548-f7c701adb301 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:33.074033 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d10a0994-b805-4aa6-8548-f7c701adb301 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1502 microversion: 2.1 time: 0.384275 Aug 17 19:40:33.074620 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 84/172] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:32 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1502 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:33.106846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-179fa78a-a6ca-4cd5-8dcd-913134b2cb0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:33.106846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-179fa78a-a6ca-4cd5-8dcd-913134b2cb0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:33.115942 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-179fa78a-a6ca-4cd5-8dcd-913134b2cb0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:33.116443 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-179fa78a-a6ca-4cd5-8dcd-913134b2cb0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:33.121028 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-179fa78a-a6ca-4cd5-8dcd-913134b2cb0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:33.122033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-179fa78a-a6ca-4cd5-8dcd-913134b2cb0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:33.122661 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-179fa78a-a6ca-4cd5-8dcd-913134b2cb0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:33.123277 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-179fa78a-a6ca-4cd5-8dcd-913134b2cb0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:33.420487 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-179fa78a-a6ca-4cd5-8dcd-913134b2cb0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:33.442335 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-179fa78a-a6ca-4cd5-8dcd-913134b2cb0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1517 microversion: 2.1 time: 0.338523 Aug 17 19:40:33.449957 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 89/173] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:33 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1517 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:34.427119 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1084865955", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "networks": [{"uuid": "3017223d-fc3d-422a-acc2-745825634714"}]}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:40:34.503780 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.network.neutron [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] validate_networks() for [('3017223d-fc3d-422a-acc2-745825634714', None, None, None, None, None)] {{(pid=132530) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:40:35.052184 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-115ac810-59c3-4707-ac8b-3a5f2a0baddd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:40:35.057148 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-115ac810-59c3-4707-ac8b-3a5f2a0baddd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:35.089329 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-115ac810-59c3-4707-ac8b-3a5f2a0baddd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:35.090386 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-115ac810-59c3-4707-ac8b-3a5f2a0baddd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:35.090844 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-115ac810-59c3-4707-ac8b-3a5f2a0baddd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:35.092282 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-115ac810-59c3-4707-ac8b-3a5f2a0baddd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:35.092737 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-115ac810-59c3-4707-ac8b-3a5f2a0baddd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:35.093152 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-115ac810-59c3-4707-ac8b-3a5f2a0baddd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:35.161626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.objects.instance [None req-115ac810-59c3-4707-ac8b-3a5f2a0baddd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lazy-loading 'flavor' on Instance uuid 001bd590-d203-4670-aef3-300aae8d4c4f {{(pid=132531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:40:35.471374 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-115ac810-59c3-4707-ac8b-3a5f2a0baddd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "POST /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f/action" status: 200 len: 32 microversion: 2.1 time: 0.423903 Aug 17 19:40:35.472422 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 90/174] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:40:35 2022] POST /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f/action => generated 32 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 19:40:35.488715 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3d9367d3-7171-45f0-8a9a-d761e15b6308 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:35.489773 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3d9367d3-7171-45f0-8a9a-d761e15b6308 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:35.517893 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3d9367d3-7171-45f0-8a9a-d761e15b6308 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:35.518392 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3d9367d3-7171-45f0-8a9a-d761e15b6308 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:35.518834 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3d9367d3-7171-45f0-8a9a-d761e15b6308 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:35.528066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3d9367d3-7171-45f0-8a9a-d761e15b6308 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:35.531616 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3d9367d3-7171-45f0-8a9a-d761e15b6308 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:35.532554 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3d9367d3-7171-45f0-8a9a-d761e15b6308 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:35.575287 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Flavor limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:40:35.577783 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Image limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:40:35.577783 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Flavor pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:40:35.577783 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Image pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:40:35.578218 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:40:35.582805 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=36 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:40:35.596086 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:35.598997 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:35.599642 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:35.602126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:35.602816 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:35.605941 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:35.662167 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Getting quotas for project 12bd76b56a1d4dbcbf306843e0ade6bf. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:40:35.686751 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Getting quotas for user cc2d61aa2c004363ba15753674123b15 and project 12bd76b56a1d4dbcbf306843e0ade6bf. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:40:35.714710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Going to run 1 instances... {{(pid=132530) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:40:35.717926 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132530) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:40:35.827828 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3e32d662-3d20-40dc-b958-08048631de6a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.408140 Aug 17 19:40:35.838140 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 85/175] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:40:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:40:35.844010 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ac64d496-bdb3-4e08-b450-0e9356d6ee1d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:35.844490 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ac64d496-bdb3-4e08-b450-0e9356d6ee1d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:36.080029 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ac64d496-bdb3-4e08-b450-0e9356d6ee1d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:36.091415 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ac64d496-bdb3-4e08-b450-0e9356d6ee1d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1214 microversion: 2.1 time: 0.249833 Aug 17 19:40:36.092248 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 86/176] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:35 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1214 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:36.181646 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3d9367d3-7171-45f0-8a9a-d761e15b6308 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:36.203810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3d9367d3-7171-45f0-8a9a-d761e15b6308 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.719951 Aug 17 19:40:36.204909 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 91/177] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:35 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:37.114310 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-532c7111-409e-445e-ad88-9231e7a96cdd tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:37.115467 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-532c7111-409e-445e-ad88-9231e7a96cdd tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:37.131840 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-532c7111-409e-445e-ad88-9231e7a96cdd tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:37.132931 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-532c7111-409e-445e-ad88-9231e7a96cdd tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:37.133408 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-532c7111-409e-445e-ad88-9231e7a96cdd tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:37.134171 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-532c7111-409e-445e-ad88-9231e7a96cdd tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:37.134677 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-532c7111-409e-445e-ad88-9231e7a96cdd tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:37.135110 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-532c7111-409e-445e-ad88-9231e7a96cdd tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:37.206811 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-532c7111-409e-445e-ad88-9231e7a96cdd tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:37.215167 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-532c7111-409e-445e-ad88-9231e7a96cdd tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1218 microversion: 2.1 time: 0.105912 Aug 17 19:40:37.218141 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 87/178] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:37 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:37.229507 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0235741c-7af6-473a-a652-03ba2f24a0f0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:37.230935 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0235741c-7af6-473a-a652-03ba2f24a0f0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:37.243361 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:40:37.245129 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0235741c-7af6-473a-a652-03ba2f24a0f0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:37.246130 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0235741c-7af6-473a-a652-03ba2f24a0f0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:37.246847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0235741c-7af6-473a-a652-03ba2f24a0f0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:37.248359 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0235741c-7af6-473a-a652-03ba2f24a0f0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:37.252255 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0235741c-7af6-473a-a652-03ba2f24a0f0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:37.253093 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0235741c-7af6-473a-a652-03ba2f24a0f0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:37.435440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0235741c-7af6-473a-a652-03ba2f24a0f0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:37.444381 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0235741c-7af6-473a-a652-03ba2f24a0f0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.218519 Aug 17 19:40:37.447291 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 92/179] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:37 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:38.237022 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-60234f6a-7e4a-409c-83ad-17a840ac112c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:38.237595 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-60234f6a-7e4a-409c-83ad-17a840ac112c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:38.244092 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-60234f6a-7e4a-409c-83ad-17a840ac112c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:38.244583 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-60234f6a-7e4a-409c-83ad-17a840ac112c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:38.245021 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-60234f6a-7e4a-409c-83ad-17a840ac112c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:38.245747 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-60234f6a-7e4a-409c-83ad-17a840ac112c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:38.246198 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-60234f6a-7e4a-409c-83ad-17a840ac112c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:38.246622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-60234f6a-7e4a-409c-83ad-17a840ac112c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:38.331132 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-60234f6a-7e4a-409c-83ad-17a840ac112c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:38.338914 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-60234f6a-7e4a-409c-83ad-17a840ac112c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1218 microversion: 2.1 time: 0.105504 Aug 17 19:40:38.339462 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 88/180] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:38 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:38.472687 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a79a9b69-e6b3-492b-8a51-d816353de7b3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:38.473363 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a79a9b69-e6b3-492b-8a51-d816353de7b3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:38.487903 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a79a9b69-e6b3-492b-8a51-d816353de7b3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:38.491066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a79a9b69-e6b3-492b-8a51-d816353de7b3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:38.493716 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a79a9b69-e6b3-492b-8a51-d816353de7b3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:38.495213 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a79a9b69-e6b3-492b-8a51-d816353de7b3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:38.499159 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a79a9b69-e6b3-492b-8a51-d816353de7b3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:38.499648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a79a9b69-e6b3-492b-8a51-d816353de7b3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:38.747019 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a79a9b69-e6b3-492b-8a51-d816353de7b3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:38.758523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a79a9b69-e6b3-492b-8a51-d816353de7b3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.292055 Aug 17 19:40:38.764310 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 93/181] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:38 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:39.358559 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-402aeebd-95e0-4fda-bf53-ffad598cca9b tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:39.359826 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-402aeebd-95e0-4fda-bf53-ffad598cca9b tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:39.368901 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-402aeebd-95e0-4fda-bf53-ffad598cca9b tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:39.371519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-402aeebd-95e0-4fda-bf53-ffad598cca9b tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:39.372855 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-402aeebd-95e0-4fda-bf53-ffad598cca9b tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:39.375244 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-402aeebd-95e0-4fda-bf53-ffad598cca9b tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:39.375924 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-402aeebd-95e0-4fda-bf53-ffad598cca9b tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:39.377989 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-402aeebd-95e0-4fda-bf53-ffad598cca9b tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:39.537105 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-402aeebd-95e0-4fda-bf53-ffad598cca9b tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:39.556565 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-402aeebd-95e0-4fda-bf53-ffad598cca9b tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1284 microversion: 2.1 time: 0.191664 Aug 17 19:40:39.571803 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 89/182] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:39 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:39.779923 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-cfd20a9e-230d-4cff-8cec-69c03be6a8b0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:39.781169 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-cfd20a9e-230d-4cff-8cec-69c03be6a8b0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:39.800997 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-cfd20a9e-230d-4cff-8cec-69c03be6a8b0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:39.802847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-cfd20a9e-230d-4cff-8cec-69c03be6a8b0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:39.804340 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-cfd20a9e-230d-4cff-8cec-69c03be6a8b0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:39.811394 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-cfd20a9e-230d-4cff-8cec-69c03be6a8b0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:39.815163 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-cfd20a9e-230d-4cff-8cec-69c03be6a8b0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:39.815741 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-cfd20a9e-230d-4cff-8cec-69c03be6a8b0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:39.885451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:40:40.227583 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-cfd20a9e-230d-4cff-8cec-69c03be6a8b0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:40.235596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-cfd20a9e-230d-4cff-8cec-69c03be6a8b0 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.461029 Aug 17 19:40:40.239347 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 94/183] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:39 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:40.581042 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d5f168c2-4353-4e3d-8e60-eaba25e3d919 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:40.581674 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d5f168c2-4353-4e3d-8e60-eaba25e3d919 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:40.596866 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d5f168c2-4353-4e3d-8e60-eaba25e3d919 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:40.598806 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d5f168c2-4353-4e3d-8e60-eaba25e3d919 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:40.600377 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d5f168c2-4353-4e3d-8e60-eaba25e3d919 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:40.602948 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d5f168c2-4353-4e3d-8e60-eaba25e3d919 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:40.603592 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d5f168c2-4353-4e3d-8e60-eaba25e3d919 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:40.604736 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d5f168c2-4353-4e3d-8e60-eaba25e3d919 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:40.823908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d5f168c2-4353-4e3d-8e60-eaba25e3d919 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:40.835641 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d5f168c2-4353-4e3d-8e60-eaba25e3d919 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1272 microversion: 2.1 time: 0.260855 Aug 17 19:40:40.836235 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 90/184] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:40 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:41.261272 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d8430d56-1a26-4fbe-beb8-60c52226d12a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:41.262529 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d8430d56-1a26-4fbe-beb8-60c52226d12a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:41.269898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d8430d56-1a26-4fbe-beb8-60c52226d12a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:41.270644 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d8430d56-1a26-4fbe-beb8-60c52226d12a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:41.272517 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d8430d56-1a26-4fbe-beb8-60c52226d12a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:41.275861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d8430d56-1a26-4fbe-beb8-60c52226d12a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:41.276351 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d8430d56-1a26-4fbe-beb8-60c52226d12a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:41.277639 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d8430d56-1a26-4fbe-beb8-60c52226d12a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:41.616522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d8430d56-1a26-4fbe-beb8-60c52226d12a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:41.658917 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d8430d56-1a26-4fbe-beb8-60c52226d12a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.400698 Aug 17 19:40:41.696112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 95/185] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:41 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:41.856456 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-414ef3e7-7328-4a24-b136-b61c0cbc0cd6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:41.857109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-414ef3e7-7328-4a24-b136-b61c0cbc0cd6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:41.873259 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-414ef3e7-7328-4a24-b136-b61c0cbc0cd6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:41.876825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-414ef3e7-7328-4a24-b136-b61c0cbc0cd6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:41.876825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-414ef3e7-7328-4a24-b136-b61c0cbc0cd6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:41.876825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-414ef3e7-7328-4a24-b136-b61c0cbc0cd6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:41.876825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-414ef3e7-7328-4a24-b136-b61c0cbc0cd6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:41.877167 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-414ef3e7-7328-4a24-b136-b61c0cbc0cd6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:42.242645 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-414ef3e7-7328-4a24-b136-b61c0cbc0cd6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:42.251831 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-414ef3e7-7328-4a24-b136-b61c0cbc0cd6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1314 microversion: 2.1 time: 0.399161 Aug 17 19:40:42.252800 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 91/186] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:41 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:42.687486 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-41f34fb5-1db6-4e10-97e6-fed68d793fce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:42.688110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-41f34fb5-1db6-4e10-97e6-fed68d793fce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:42.694642 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-41f34fb5-1db6-4e10-97e6-fed68d793fce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:42.695134 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-41f34fb5-1db6-4e10-97e6-fed68d793fce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:42.695577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-41f34fb5-1db6-4e10-97e6-fed68d793fce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:42.696282 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-41f34fb5-1db6-4e10-97e6-fed68d793fce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:42.696756 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-41f34fb5-1db6-4e10-97e6-fed68d793fce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:42.697162 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-41f34fb5-1db6-4e10-97e6-fed68d793fce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:42.905005 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-41f34fb5-1db6-4e10-97e6-fed68d793fce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:42.917556 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-41f34fb5-1db6-4e10-97e6-fed68d793fce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.229777 Aug 17 19:40:42.920292 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 96/187] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:42 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:43.278668 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ee7bf153-bc63-4acd-84e7-44db750159ac tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:43.282525 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ee7bf153-bc63-4acd-84e7-44db750159ac tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:43.294765 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ee7bf153-bc63-4acd-84e7-44db750159ac tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:43.297258 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ee7bf153-bc63-4acd-84e7-44db750159ac tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:43.298377 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ee7bf153-bc63-4acd-84e7-44db750159ac tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:43.300043 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ee7bf153-bc63-4acd-84e7-44db750159ac tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:43.300789 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ee7bf153-bc63-4acd-84e7-44db750159ac tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:43.301407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ee7bf153-bc63-4acd-84e7-44db750159ac tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:43.511820 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ee7bf153-bc63-4acd-84e7-44db750159ac tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:43.523992 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ee7bf153-bc63-4acd-84e7-44db750159ac tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1314 microversion: 2.1 time: 0.252154 Aug 17 19:40:43.538768 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 92/188] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:43 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:43.941916 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-74e852da-3d30-492e-97c9-c200ed2f0c44 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:43.943332 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-74e852da-3d30-492e-97c9-c200ed2f0c44 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:43.968610 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-74e852da-3d30-492e-97c9-c200ed2f0c44 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:43.969260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-74e852da-3d30-492e-97c9-c200ed2f0c44 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:43.970504 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-74e852da-3d30-492e-97c9-c200ed2f0c44 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:43.974609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-74e852da-3d30-492e-97c9-c200ed2f0c44 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:43.975096 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-74e852da-3d30-492e-97c9-c200ed2f0c44 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:43.975537 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-74e852da-3d30-492e-97c9-c200ed2f0c44 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:44.187916 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-74e852da-3d30-492e-97c9-c200ed2f0c44 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:44.197808 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-74e852da-3d30-492e-97c9-c200ed2f0c44 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.258583 Aug 17 19:40:44.199095 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 97/189] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:43 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:44.553755 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-0ad1bd73-fec2-4022-b7cd-1ea32fab4387 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:44.555115 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-0ad1bd73-fec2-4022-b7cd-1ea32fab4387 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:44.572209 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0ad1bd73-fec2-4022-b7cd-1ea32fab4387 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:44.573107 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0ad1bd73-fec2-4022-b7cd-1ea32fab4387 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:44.573773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0ad1bd73-fec2-4022-b7cd-1ea32fab4387 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:44.574674 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0ad1bd73-fec2-4022-b7cd-1ea32fab4387 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:44.576835 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0ad1bd73-fec2-4022-b7cd-1ea32fab4387 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:44.577458 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0ad1bd73-fec2-4022-b7cd-1ea32fab4387 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:44.820502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0ad1bd73-fec2-4022-b7cd-1ea32fab4387 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:44.850825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-0ad1bd73-fec2-4022-b7cd-1ea32fab4387 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1314 microversion: 2.1 time: 0.310779 Aug 17 19:40:44.855688 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 93/190] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:44 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:45.215068 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-44b4460e-00e6-417d-bc3f-8e0e36b3f7c8 req-59ba4329-f159-4546-a2f9-fe9bbcf74eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e387f9d1-6210-4065-a923-4bcb9b92d77b", "tag": "f7334bd8-62fe-48ac-941a-26a70056762b"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:40:45.219759 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-023210ce-ca4a-4899-add5-0b6583436499 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:45.220478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-023210ce-ca4a-4899-add5-0b6583436499 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:45.239579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-023210ce-ca4a-4899-add5-0b6583436499 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:45.243714 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-023210ce-ca4a-4899-add5-0b6583436499 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:45.251333 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-023210ce-ca4a-4899-add5-0b6583436499 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:45.253879 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-44b4460e-00e6-417d-bc3f-8e0e36b3f7c8 req-59ba4329-f159-4546-a2f9-fe9bbcf74eae service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:45.254081 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-023210ce-ca4a-4899-add5-0b6583436499 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:45.254498 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-023210ce-ca4a-4899-add5-0b6583436499 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:45.254809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-44b4460e-00e6-417d-bc3f-8e0e36b3f7c8 req-59ba4329-f159-4546-a2f9-fe9bbcf74eae service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:45.255290 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-44b4460e-00e6-417d-bc3f-8e0e36b3f7c8 req-59ba4329-f159-4546-a2f9-fe9bbcf74eae service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:45.256240 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-023210ce-ca4a-4899-add5-0b6583436499 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:45.281275 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-44b4460e-00e6-417d-bc3f-8e0e36b3f7c8 req-59ba4329-f159-4546-a2f9-fe9bbcf74eae service nova] Creating event network-changed:f7334bd8-62fe-48ac-941a-26a70056762b for instance e387f9d1-6210-4065-a923-4bcb9b92d77b on hv-cinder-85069 Aug 17 19:40:45.289308 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-44b4460e-00e6-417d-bc3f-8e0e36b3f7c8 req-59ba4329-f159-4546-a2f9-fe9bbcf74eae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078593 Aug 17 19:40:45.297514 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 98/191] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:40:45.552077 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-023210ce-ca4a-4899-add5-0b6583436499 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:45.562940 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-023210ce-ca4a-4899-add5-0b6583436499 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.348330 Aug 17 19:40:45.564647 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 94/192] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:45 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:45.681515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0c01ba2e-9f01-43f8-813a-f1f0f9785673 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:45.687756 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0c01ba2e-9f01-43f8-813a-f1f0f9785673 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:45.708217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0c01ba2e-9f01-43f8-813a-f1f0f9785673 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:45.710632 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0c01ba2e-9f01-43f8-813a-f1f0f9785673 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:45.711955 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0c01ba2e-9f01-43f8-813a-f1f0f9785673 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:45.718850 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0c01ba2e-9f01-43f8-813a-f1f0f9785673 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:45.720570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0c01ba2e-9f01-43f8-813a-f1f0f9785673 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:45.723105 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0c01ba2e-9f01-43f8-813a-f1f0f9785673 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:45.795159 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0c01ba2e-9f01-43f8-813a-f1f0f9785673 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/ips" status: 200 len: 145 microversion: 2.1 time: 0.118002 Aug 17 19:40:45.811523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 99/193] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 17 19:40:45 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/ips => generated 145 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:40:45.888244 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ad1e3d47-22cd-4c8a-a674-384c9833f2c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:45.888768 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ad1e3d47-22cd-4c8a-a674-384c9833f2c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:45.897239 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:40:45.899039 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ad1e3d47-22cd-4c8a-a674-384c9833f2c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:45.899985 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ad1e3d47-22cd-4c8a-a674-384c9833f2c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:45.900584 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ad1e3d47-22cd-4c8a-a674-384c9833f2c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:45.901926 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ad1e3d47-22cd-4c8a-a674-384c9833f2c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:45.902537 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ad1e3d47-22cd-4c8a-a674-384c9833f2c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:45.903127 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ad1e3d47-22cd-4c8a-a674-384c9833f2c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:46.090555 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=8 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:40:46.133035 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ad1e3d47-22cd-4c8a-a674-384c9833f2c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:46.143515 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ad1e3d47-22cd-4c8a-a674-384c9833f2c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1314 microversion: 2.1 time: 0.271817 Aug 17 19:40:46.144689 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 95/194] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:45 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:46.587696 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-71c3a089-b3ba-4e28-bec2-e72648692c65 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:46.605812 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-71c3a089-b3ba-4e28-bec2-e72648692c65 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:46.629735 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-71c3a089-b3ba-4e28-bec2-e72648692c65 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:46.630236 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-71c3a089-b3ba-4e28-bec2-e72648692c65 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:46.630678 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-71c3a089-b3ba-4e28-bec2-e72648692c65 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:46.631383 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-71c3a089-b3ba-4e28-bec2-e72648692c65 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:46.631853 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-71c3a089-b3ba-4e28-bec2-e72648692c65 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:46.632279 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-71c3a089-b3ba-4e28-bec2-e72648692c65 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:46.908454 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-71c3a089-b3ba-4e28-bec2-e72648692c65 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:46.935827 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-71c3a089-b3ba-4e28-bec2-e72648692c65 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.351656 Aug 17 19:40:46.936442 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 100/195] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:46 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:47.168797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c8a165de-ea83-49ec-a6bc-3fe5c65949e5 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:47.170228 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c8a165de-ea83-49ec-a6bc-3fe5c65949e5 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:47.183407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8a165de-ea83-49ec-a6bc-3fe5c65949e5 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:47.185705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8a165de-ea83-49ec-a6bc-3fe5c65949e5 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:47.186342 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8a165de-ea83-49ec-a6bc-3fe5c65949e5 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:47.187067 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8a165de-ea83-49ec-a6bc-3fe5c65949e5 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:47.187528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8a165de-ea83-49ec-a6bc-3fe5c65949e5 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:47.187951 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8a165de-ea83-49ec-a6bc-3fe5c65949e5 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:47.436545 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c8a165de-ea83-49ec-a6bc-3fe5c65949e5 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:47.445991 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c8a165de-ea83-49ec-a6bc-3fe5c65949e5 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1314 microversion: 2.1 time: 0.284360 Aug 17 19:40:47.448222 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 96/196] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:47 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:47.962313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0ca94e99-1e3f-401b-b3a7-59a01ee68386 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:47.963407 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0ca94e99-1e3f-401b-b3a7-59a01ee68386 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:47.997442 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0ca94e99-1e3f-401b-b3a7-59a01ee68386 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:47.997553 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0ca94e99-1e3f-401b-b3a7-59a01ee68386 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:47.998025 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0ca94e99-1e3f-401b-b3a7-59a01ee68386 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:48.007215 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0ca94e99-1e3f-401b-b3a7-59a01ee68386 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:48.012359 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0ca94e99-1e3f-401b-b3a7-59a01ee68386 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:48.013316 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0ca94e99-1e3f-401b-b3a7-59a01ee68386 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:48.036986 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4838d9df-0d77-4d29-9127-284ebe6a6065 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:48.041572 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4838d9df-0d77-4d29-9127-284ebe6a6065 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:48.056710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4838d9df-0d77-4d29-9127-284ebe6a6065 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:48.059222 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4838d9df-0d77-4d29-9127-284ebe6a6065 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:48.059909 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4838d9df-0d77-4d29-9127-284ebe6a6065 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:48.060825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4838d9df-0d77-4d29-9127-284ebe6a6065 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:48.062115 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4838d9df-0d77-4d29-9127-284ebe6a6065 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:48.063633 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4838d9df-0d77-4d29-9127-284ebe6a6065 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:48.134421 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4838d9df-0d77-4d29-9127-284ebe6a6065 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/ips" status: 200 len: 151 microversion: 2.20 time: 0.102626 Aug 17 19:40:48.137057 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 97/197] 10.222.0.59 () {60 vars in 1289 bytes} [Wed Aug 17 19:40:48 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/ips => generated 151 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:40:48.370094 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0ca94e99-1e3f-401b-b3a7-59a01ee68386 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:48.381339 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0ca94e99-1e3f-401b-b3a7-59a01ee68386 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.424049 Aug 17 19:40:48.382598 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 101/198] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:47 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:48.471211 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-de25c29e-ac04-419f-8658-41cce9cc2d17 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:48.472156 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-de25c29e-ac04-419f-8658-41cce9cc2d17 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:48.487499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de25c29e-ac04-419f-8658-41cce9cc2d17 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:48.488820 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de25c29e-ac04-419f-8658-41cce9cc2d17 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:48.489930 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de25c29e-ac04-419f-8658-41cce9cc2d17 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:48.492303 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de25c29e-ac04-419f-8658-41cce9cc2d17 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:48.493818 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de25c29e-ac04-419f-8658-41cce9cc2d17 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:48.495149 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de25c29e-ac04-419f-8658-41cce9cc2d17 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:48.778464 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-de25c29e-ac04-419f-8658-41cce9cc2d17 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:48.790720 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-de25c29e-ac04-419f-8658-41cce9cc2d17 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1314 microversion: 2.1 time: 0.325243 Aug 17 19:40:48.804277 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 98/199] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:48 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:49.263492 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6cbbddfb-bf24-4a05-9037-915db39b19a9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "273434bd-f439-45f2-a0f2-1cd4cfa2d71b"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:40:49.267259 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6cbbddfb-bf24-4a05-9037-915db39b19a9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:49.280352 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6cbbddfb-bf24-4a05-9037-915db39b19a9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:49.285732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6cbbddfb-bf24-4a05-9037-915db39b19a9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:49.286127 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6cbbddfb-bf24-4a05-9037-915db39b19a9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:49.287880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6cbbddfb-bf24-4a05-9037-915db39b19a9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:49.288504 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6cbbddfb-bf24-4a05-9037-915db39b19a9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:49.289108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6cbbddfb-bf24-4a05-9037-915db39b19a9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:49.404798 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-558563c9-8a2b-4416-800e-3de92f67834b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:49.405844 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-558563c9-8a2b-4416-800e-3de92f67834b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:49.421407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-558563c9-8a2b-4416-800e-3de92f67834b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:49.421974 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-558563c9-8a2b-4416-800e-3de92f67834b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:49.422556 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-558563c9-8a2b-4416-800e-3de92f67834b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:49.423394 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-558563c9-8a2b-4416-800e-3de92f67834b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:49.424242 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-558563c9-8a2b-4416-800e-3de92f67834b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:49.426056 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-558563c9-8a2b-4416-800e-3de92f67834b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:49.456199 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=100 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:40:49.608460 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-558563c9-8a2b-4416-800e-3de92f67834b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:49.618068 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-558563c9-8a2b-4416-800e-3de92f67834b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.217964 Aug 17 19:40:49.619179 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 99/200] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:49 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:49.758166 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6cbbddfb-bf24-4a05-9037-915db39b19a9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "POST /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.499122 Aug 17 19:40:49.770755 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 102/201] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:40:49 2022] POST /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/os-volume_attachments => generated 194 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:40:49.813698 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-874d8044-18e4-47a9-a18b-4cf9984d26cc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:49.822914 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-874d8044-18e4-47a9-a18b-4cf9984d26cc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:49.836765 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-874d8044-18e4-47a9-a18b-4cf9984d26cc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:49.837366 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-874d8044-18e4-47a9-a18b-4cf9984d26cc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:49.837923 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-874d8044-18e4-47a9-a18b-4cf9984d26cc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:49.838736 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-874d8044-18e4-47a9-a18b-4cf9984d26cc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:49.840503 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-874d8044-18e4-47a9-a18b-4cf9984d26cc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:49.841900 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-874d8044-18e4-47a9-a18b-4cf9984d26cc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:50.120084 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-874d8044-18e4-47a9-a18b-4cf9984d26cc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:50.135512 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-874d8044-18e4-47a9-a18b-4cf9984d26cc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1314 microversion: 2.1 time: 0.326284 Aug 17 19:40:50.147499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 100/202] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:49 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:50.646008 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-755304fa-9943-4b4b-9de8-248cf3ef9469 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:50.646800 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-755304fa-9943-4b4b-9de8-248cf3ef9469 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:50.661741 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-755304fa-9943-4b4b-9de8-248cf3ef9469 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:50.662261 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-755304fa-9943-4b4b-9de8-248cf3ef9469 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:50.662705 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-755304fa-9943-4b4b-9de8-248cf3ef9469 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:50.666173 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-755304fa-9943-4b4b-9de8-248cf3ef9469 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:50.666721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-755304fa-9943-4b4b-9de8-248cf3ef9469 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:50.667169 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-755304fa-9943-4b4b-9de8-248cf3ef9469 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:50.899303 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-755304fa-9943-4b4b-9de8-248cf3ef9469 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:50.918687 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-755304fa-9943-4b4b-9de8-248cf3ef9469 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.277848 Aug 17 19:40:50.927038 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 103/203] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:50 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:51.159478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e783824d-944c-4f10-90c4-83c197fa05a0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:51.160088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e783824d-944c-4f10-90c4-83c197fa05a0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:51.170282 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e783824d-944c-4f10-90c4-83c197fa05a0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:51.171015 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e783824d-944c-4f10-90c4-83c197fa05a0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:51.171644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e783824d-944c-4f10-90c4-83c197fa05a0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:51.172516 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e783824d-944c-4f10-90c4-83c197fa05a0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:51.173128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e783824d-944c-4f10-90c4-83c197fa05a0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:51.173724 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e783824d-944c-4f10-90c4-83c197fa05a0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:51.368010 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e783824d-944c-4f10-90c4-83c197fa05a0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:51.379888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e783824d-944c-4f10-90c4-83c197fa05a0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1314 microversion: 2.1 time: 0.224275 Aug 17 19:40:51.385709 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 101/204] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:51 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:51.505128 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-663af051-5cb6-4401-976b-e03f6ea6ac1c req-27cf5933-45c3-4133-bab6-a2e6add10770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e387f9d1-6210-4065-a923-4bcb9b92d77b", "name": "network-vif-plugged", "status": "completed", "tag": "f7334bd8-62fe-48ac-941a-26a70056762b"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:40:51.512541 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ec9fe681-00e2-4cf0-b47e-16ce739a8978 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:40:51.513660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ec9fe681-00e2-4cf0-b47e-16ce739a8978 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:51.531828 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec9fe681-00e2-4cf0-b47e-16ce739a8978 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:51.532504 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec9fe681-00e2-4cf0-b47e-16ce739a8978 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:51.533105 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec9fe681-00e2-4cf0-b47e-16ce739a8978 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:51.534003 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec9fe681-00e2-4cf0-b47e-16ce739a8978 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:51.536518 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec9fe681-00e2-4cf0-b47e-16ce739a8978 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:51.539516 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec9fe681-00e2-4cf0-b47e-16ce739a8978 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:51.549587 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-663af051-5cb6-4401-976b-e03f6ea6ac1c req-27cf5933-45c3-4133-bab6-a2e6add10770 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:51.550093 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-663af051-5cb6-4401-976b-e03f6ea6ac1c req-27cf5933-45c3-4133-bab6-a2e6add10770 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:51.550522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-663af051-5cb6-4401-976b-e03f6ea6ac1c req-27cf5933-45c3-4133-bab6-a2e6add10770 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:51.582303 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-663af051-5cb6-4401-976b-e03f6ea6ac1c req-27cf5933-45c3-4133-bab6-a2e6add10770 service nova] Creating event network-vif-plugged:f7334bd8-62fe-48ac-941a-26a70056762b for instance e387f9d1-6210-4065-a923-4bcb9b92d77b on hv-cinder-85069 Aug 17 19:40:51.602685 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-663af051-5cb6-4401-976b-e03f6ea6ac1c req-27cf5933-45c3-4133-bab6-a2e6add10770 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101093 Aug 17 19:40:51.607912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-ec9fe681-00e2-4cf0-b47e-16ce739a8978 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lazy-loading 'flavor' on Instance uuid b04daa67-36a6-4a53-b80a-e90f77348028 {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:40:51.610997 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 104/205] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:40:51.953815 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-17cf958b-63fa-4bce-ba11-b4f8e467a639 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:51.958398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-17cf958b-63fa-4bce-ba11-b4f8e467a639 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:51.967131 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-17cf958b-63fa-4bce-ba11-b4f8e467a639 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:51.967895 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-17cf958b-63fa-4bce-ba11-b4f8e467a639 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:51.969293 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-17cf958b-63fa-4bce-ba11-b4f8e467a639 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:51.970971 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-17cf958b-63fa-4bce-ba11-b4f8e467a639 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:51.971621 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-17cf958b-63fa-4bce-ba11-b4f8e467a639 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:51.972223 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-17cf958b-63fa-4bce-ba11-b4f8e467a639 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:52.177328 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-17cf958b-63fa-4bce-ba11-b4f8e467a639 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:52.191284 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-17cf958b-63fa-4bce-ba11-b4f8e467a639 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.244503 Aug 17 19:40:52.192869 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 105/206] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:51 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:52.401688 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a4cc518e-38cc-44e6-87d7-0e7ee9d25dea tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:52.402388 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a4cc518e-38cc-44e6-87d7-0e7ee9d25dea tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:52.413400 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4cc518e-38cc-44e6-87d7-0e7ee9d25dea tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:52.413978 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4cc518e-38cc-44e6-87d7-0e7ee9d25dea tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:52.414488 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4cc518e-38cc-44e6-87d7-0e7ee9d25dea tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:52.415276 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4cc518e-38cc-44e6-87d7-0e7ee9d25dea tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:52.415805 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4cc518e-38cc-44e6-87d7-0e7ee9d25dea tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:52.416627 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4cc518e-38cc-44e6-87d7-0e7ee9d25dea tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:52.703868 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a4cc518e-38cc-44e6-87d7-0e7ee9d25dea tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:52.703868 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a4cc518e-38cc-44e6-87d7-0e7ee9d25dea tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1314 microversion: 2.1 time: 0.306131 Aug 17 19:40:52.704200 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 106/207] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:52 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:53.224229 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-122242fa-a111-485a-a8a4-e8371f1f2d0f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:53.225759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-122242fa-a111-485a-a8a4-e8371f1f2d0f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:53.261300 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-122242fa-a111-485a-a8a4-e8371f1f2d0f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:53.266233 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-122242fa-a111-485a-a8a4-e8371f1f2d0f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:53.268444 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-122242fa-a111-485a-a8a4-e8371f1f2d0f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:53.272417 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-122242fa-a111-485a-a8a4-e8371f1f2d0f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:53.279595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-122242fa-a111-485a-a8a4-e8371f1f2d0f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:53.280348 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-122242fa-a111-485a-a8a4-e8371f1f2d0f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:53.566313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-122242fa-a111-485a-a8a4-e8371f1f2d0f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:53.578831 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-122242fa-a111-485a-a8a4-e8371f1f2d0f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.362848 Aug 17 19:40:53.597536 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 107/208] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:53 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:53.726408 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-2a5c951f-1249-4cb8-a894-5c146304f650 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:53.727087 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-2a5c951f-1249-4cb8-a894-5c146304f650 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:53.737959 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2a5c951f-1249-4cb8-a894-5c146304f650 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:53.738451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2a5c951f-1249-4cb8-a894-5c146304f650 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:53.738886 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2a5c951f-1249-4cb8-a894-5c146304f650 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:53.739580 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2a5c951f-1249-4cb8-a894-5c146304f650 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:53.740036 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2a5c951f-1249-4cb8-a894-5c146304f650 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:53.740459 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2a5c951f-1249-4cb8-a894-5c146304f650 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:54.008169 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2a5c951f-1249-4cb8-a894-5c146304f650 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:54.021247 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-2a5c951f-1249-4cb8-a894-5c146304f650 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1498 microversion: 2.1 time: 0.299193 Aug 17 19:40:54.025198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 108/209] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:53 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1498 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:54.604359 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-46e50af7-2b59-49e7-8b6a-989ab12fa9ad tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:54.605181 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-46e50af7-2b59-49e7-8b6a-989ab12fa9ad tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:54.618536 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-46e50af7-2b59-49e7-8b6a-989ab12fa9ad tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:54.623300 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-46e50af7-2b59-49e7-8b6a-989ab12fa9ad tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:54.623744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-46e50af7-2b59-49e7-8b6a-989ab12fa9ad tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:54.624479 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-46e50af7-2b59-49e7-8b6a-989ab12fa9ad tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:54.624951 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-46e50af7-2b59-49e7-8b6a-989ab12fa9ad tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:54.626792 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-46e50af7-2b59-49e7-8b6a-989ab12fa9ad tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:54.846594 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-46e50af7-2b59-49e7-8b6a-989ab12fa9ad tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:54.855586 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-46e50af7-2b59-49e7-8b6a-989ab12fa9ad tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.256709 Aug 17 19:40:54.856977 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 109/210] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:54 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:54.873044 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d474f889-a80e-4a2a-a872-b96698282e4c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:54.879740 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d474f889-a80e-4a2a-a872-b96698282e4c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:54.889462 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d474f889-a80e-4a2a-a872-b96698282e4c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:54.890040 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d474f889-a80e-4a2a-a872-b96698282e4c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:54.890546 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d474f889-a80e-4a2a-a872-b96698282e4c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:54.891318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d474f889-a80e-4a2a-a872-b96698282e4c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:54.891846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d474f889-a80e-4a2a-a872-b96698282e4c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:54.892337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d474f889-a80e-4a2a-a872-b96698282e4c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:54.921359 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d474f889-a80e-4a2a-a872-b96698282e4c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:40:54.937081 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:40:55.027664 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d474f889-a80e-4a2a-a872-b96698282e4c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 204 len: 0 microversion: 2.1 time: 0.166617 Aug 17 19:40:55.029323 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 110/211] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:40:54 2022] DELETE /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:40:55.040343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6080aaf1-a0ca-432e-8b60-27c00ccd47b6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:55.041057 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6080aaf1-a0ca-432e-8b60-27c00ccd47b6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:55.047101 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6080aaf1-a0ca-432e-8b60-27c00ccd47b6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:55.047590 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6080aaf1-a0ca-432e-8b60-27c00ccd47b6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:55.048092 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6080aaf1-a0ca-432e-8b60-27c00ccd47b6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:55.048792 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6080aaf1-a0ca-432e-8b60-27c00ccd47b6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:55.049562 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6080aaf1-a0ca-432e-8b60-27c00ccd47b6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:55.050223 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6080aaf1-a0ca-432e-8b60-27c00ccd47b6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:55.211598 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6080aaf1-a0ca-432e-8b60-27c00ccd47b6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:55.230797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6080aaf1-a0ca-432e-8b60-27c00ccd47b6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1504 microversion: 2.1 time: 0.197330 Aug 17 19:40:55.231800 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 111/212] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:55 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:55.880434 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3693ee19-1143-41af-a2ef-e0ae4c9c7c70 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:55.881200 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3693ee19-1143-41af-a2ef-e0ae4c9c7c70 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:55.892049 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3693ee19-1143-41af-a2ef-e0ae4c9c7c70 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:55.892530 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3693ee19-1143-41af-a2ef-e0ae4c9c7c70 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:55.892963 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3693ee19-1143-41af-a2ef-e0ae4c9c7c70 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:55.893681 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3693ee19-1143-41af-a2ef-e0ae4c9c7c70 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:55.894333 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3693ee19-1143-41af-a2ef-e0ae4c9c7c70 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:55.894920 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3693ee19-1143-41af-a2ef-e0ae4c9c7c70 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:56.073206 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3693ee19-1143-41af-a2ef-e0ae4c9c7c70 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:56.089141 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3693ee19-1143-41af-a2ef-e0ae4c9c7c70 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.214099 Aug 17 19:40:56.098226 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 112/213] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:55 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:56.254889 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0f82db49-2788-45ab-a721-74239013f171 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:56.255702 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0f82db49-2788-45ab-a721-74239013f171 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:56.265411 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f82db49-2788-45ab-a721-74239013f171 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:56.265411 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f82db49-2788-45ab-a721-74239013f171 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:56.269652 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f82db49-2788-45ab-a721-74239013f171 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:56.269889 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f82db49-2788-45ab-a721-74239013f171 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:56.270184 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f82db49-2788-45ab-a721-74239013f171 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:56.270603 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f82db49-2788-45ab-a721-74239013f171 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:56.438027 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0f82db49-2788-45ab-a721-74239013f171 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:56.445801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0f82db49-2788-45ab-a721-74239013f171 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1504 microversion: 2.1 time: 0.197144 Aug 17 19:40:56.446562 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 113/214] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:56 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:57.014191 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b3b9ef10-ec2e-488a-853e-203d5e2a840f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Action: 'create', calling method: .version_select at 0x7f368a3e7160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1876399247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpkUB314C+DNn1eFQuAJfJtbo3hvBa0rrMsryFGL1edbtlLprKb9VDQ5ofVcxAfcpcEL5HrQJAoIEtxNuvswk7GwaMC6LXl4KQbMJDq82wypbBnVkITjNdLx9YWtySm8g=="}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:40:57.031980 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-b3b9ef10-ec2e-488a-853e-203d5e2a840f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Getting quotas for project cd2089b2265341b291a0db883f0d211f. Resources: {'key_pairs'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:40:57.036867 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-b3b9ef10-ec2e-488a-853e-203d5e2a840f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Getting quotas for user 0fbaae2c269740158bed223697bde03d and project cd2089b2265341b291a0db883f0d211f. Resources: {'key_pairs'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:40:57.070318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b3b9ef10-ec2e-488a-853e-203d5e2a840f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.061228 Aug 17 19:40:57.070992 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 114/215] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 17 19:40:57 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:40:57.111663 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-07f793e7-1561-4c42-bbae-39c76e5e3edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:57.113527 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-07f793e7-1561-4c42-bbae-39c76e5e3edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:57.122494 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-07f793e7-1561-4c42-bbae-39c76e5e3edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:57.123319 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-07f793e7-1561-4c42-bbae-39c76e5e3edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:57.124061 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-07f793e7-1561-4c42-bbae-39c76e5e3edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:57.125282 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-07f793e7-1561-4c42-bbae-39c76e5e3edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:57.126146 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-07f793e7-1561-4c42-bbae-39c76e5e3edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:57.126769 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-07f793e7-1561-4c42-bbae-39c76e5e3edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:57.127253 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ec9fe681-00e2-4cf0-b47e-16ce739a8978 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "POST /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/action" status: 202 len: 0 microversion: 2.20 time: 5.618024 Aug 17 19:40:57.128507 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 102/216] 10.222.0.59 () {62 vars in 1319 bytes} [Wed Aug 17 19:40:51 2022] POST /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/action => generated 0 bytes in 5620 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:40:57.142545 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-44357d44-60a2-4684-8312-38495d61b3f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:57.143762 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-44357d44-60a2-4684-8312-38495d61b3f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:57.153510 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-44357d44-60a2-4684-8312-38495d61b3f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:57.154412 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-44357d44-60a2-4684-8312-38495d61b3f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:57.155052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-44357d44-60a2-4684-8312-38495d61b3f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:57.156223 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-44357d44-60a2-4684-8312-38495d61b3f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:57.157483 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-44357d44-60a2-4684-8312-38495d61b3f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:57.158090 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-44357d44-60a2-4684-8312-38495d61b3f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:57.379699 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-07f793e7-1561-4c42-bbae-39c76e5e3edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:57.391385 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-07f793e7-1561-4c42-bbae-39c76e5e3edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.283543 Aug 17 19:40:57.392735 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 115/217] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:57 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:57.398572 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-283698376", "imageRef": "bd5ce412-15f2-453d-b706-c9f352cfa3fe", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1876399247", "networks": [{"uuid": "e26875a7-1e1d-4110-a54a-ba7eb4932396"}]}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:40:57.429625 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-44357d44-60a2-4684-8312-38495d61b3f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:57.441647 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-44357d44-60a2-4684-8312-38495d61b3f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:57.444044 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-44357d44-60a2-4684-8312-38495d61b3f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:57.445663 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-44357d44-60a2-4684-8312-38495d61b3f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.312212 Aug 17 19:40:57.451819 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 103/218] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:40:57 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:40:57.468882 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8b56ddae-061e-43d5-ad10-b6410974da14 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:57.469535 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-8b56ddae-061e-43d5-ad10-b6410974da14 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:57.477200 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8b56ddae-061e-43d5-ad10-b6410974da14 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:57.477715 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8b56ddae-061e-43d5-ad10-b6410974da14 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:57.478157 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8b56ddae-061e-43d5-ad10-b6410974da14 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:57.478927 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8b56ddae-061e-43d5-ad10-b6410974da14 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:57.479383 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8b56ddae-061e-43d5-ad10-b6410974da14 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:57.479995 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8b56ddae-061e-43d5-ad10-b6410974da14 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:57.483349 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.network.neutron [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] validate_networks() for [('e26875a7-1e1d-4110-a54a-ba7eb4932396', None, None, None, None, None)] {{(pid=132531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:40:57.737629 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8b56ddae-061e-43d5-ad10-b6410974da14 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:57.748100 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8b56ddae-061e-43d5-ad10-b6410974da14 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1504 microversion: 2.1 time: 0.285146 Aug 17 19:40:57.769851 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 104/219] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:57 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:57.779841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-cdd70b4d-b8cc-44e3-b0bc-70a0a817d5ff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:40:57.802372 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cdd70b4d-b8cc-44e3-b0bc-70a0a817d5ff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:57.802901 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cdd70b4d-b8cc-44e3-b0bc-70a0a817d5ff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:57.803356 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cdd70b4d-b8cc-44e3-b0bc-70a0a817d5ff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:57.879804 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-cdd70b4d-b8cc-44e3-b0bc-70a0a817d5ff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Going to try to stop instance {{(pid=132530) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 19:40:57.930869 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-cdd70b4d-b8cc-44e3-b0bc-70a0a817d5ff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "POST /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/action" status: 202 len: 0 microversion: 2.1 time: 0.159624 Aug 17 19:40:57.931515 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 105/220] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:40:57 2022] POST /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:40:57.936877 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-73dded40-c981-463a-94e7-d7c3a9c55383 req-3a1f362f-f918-4beb-a8e1-81752b7fe99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e387f9d1-6210-4065-a923-4bcb9b92d77b", "name": "network-vif-deleted", "tag": "f7334bd8-62fe-48ac-941a-26a70056762b"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:40:57.946770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-73dded40-c981-463a-94e7-d7c3a9c55383 req-3a1f362f-f918-4beb-a8e1-81752b7fe99e service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:57.947239 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-73dded40-c981-463a-94e7-d7c3a9c55383 req-3a1f362f-f918-4beb-a8e1-81752b7fe99e service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:57.947662 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-73dded40-c981-463a-94e7-d7c3a9c55383 req-3a1f362f-f918-4beb-a8e1-81752b7fe99e service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:57.959187 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-73dded40-c981-463a-94e7-d7c3a9c55383 req-3a1f362f-f918-4beb-a8e1-81752b7fe99e service nova] Creating event network-vif-deleted:f7334bd8-62fe-48ac-941a-26a70056762b for instance e387f9d1-6210-4065-a923-4bcb9b92d77b on hv-cinder-85069 Aug 17 19:40:57.964021 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-73dded40-c981-463a-94e7-d7c3a9c55383 req-3a1f362f-f918-4beb-a8e1-81752b7fe99e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031097 Aug 17 19:40:57.964609 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 106/221] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:40:57.970038 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5eb156ce-29fb-490a-a4d7-47190b4bea8a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:57.970717 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5eb156ce-29fb-490a-a4d7-47190b4bea8a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:57.976902 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5eb156ce-29fb-490a-a4d7-47190b4bea8a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:57.977482 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5eb156ce-29fb-490a-a4d7-47190b4bea8a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:57.977909 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5eb156ce-29fb-490a-a4d7-47190b4bea8a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:57.978604 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5eb156ce-29fb-490a-a4d7-47190b4bea8a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:57.979051 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5eb156ce-29fb-490a-a4d7-47190b4bea8a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:57.979464 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5eb156ce-29fb-490a-a4d7-47190b4bea8a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:58.040508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Flavor limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:40:58.040978 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Image limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:40:58.041549 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Flavor pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:40:58.042032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Image pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:40:58.042512 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:40:58.052277 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:58.053261 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:58.053771 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:58.054570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:58.055200 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:58.055623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:58.072975 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Getting quotas for project cd2089b2265341b291a0db883f0d211f. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:40:58.077923 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Getting quotas for user 0fbaae2c269740158bed223697bde03d and project cd2089b2265341b291a0db883f0d211f. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:40:58.089677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Going to run 1 instances... {{(pid=132531) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:40:58.092551 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd5ce412-15f2-453d-b706-c9f352cfa3fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:40:58.131593 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5eb156ce-29fb-490a-a4d7-47190b4bea8a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:58.139748 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-af88e50c-7d00-4838-9b4f-823d45bf8681 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745703 Aug 17 19:40:58.140384 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 116/222] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:40:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:40:58.142694 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5eb156ce-29fb-490a-a4d7-47190b4bea8a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1724 microversion: 2.1 time: 0.176876 Aug 17 19:40:58.149148 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 107/223] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:57 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:58.154301 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-071a569f-1c46-426a-8e76-203c6b2adced tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:58.154908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-071a569f-1c46-426a-8e76-203c6b2adced tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:58.209827 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-071a569f-1c46-426a-8e76-203c6b2adced tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:58.216607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-071a569f-1c46-426a-8e76-203c6b2adced tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1258 microversion: 2.1 time: 0.066140 Aug 17 19:40:58.217167 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 117/224] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:58 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:58.412493 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-0197f30f-fadd-49b7-bf65-323a793a5867 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:58.413084 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-0197f30f-fadd-49b7-bf65-323a793a5867 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:58.423843 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0197f30f-fadd-49b7-bf65-323a793a5867 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:58.424428 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0197f30f-fadd-49b7-bf65-323a793a5867 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:58.425463 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0197f30f-fadd-49b7-bf65-323a793a5867 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:58.426454 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0197f30f-fadd-49b7-bf65-323a793a5867 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:58.427138 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0197f30f-fadd-49b7-bf65-323a793a5867 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:58.428909 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0197f30f-fadd-49b7-bf65-323a793a5867 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:58.474450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6e664def-f0f6-4de9-aafd-3d3e4fa74a98 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:58.475198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6e664def-f0f6-4de9-aafd-3d3e4fa74a98 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:58.493876 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6e664def-f0f6-4de9-aafd-3d3e4fa74a98 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:58.494377 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6e664def-f0f6-4de9-aafd-3d3e4fa74a98 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:58.494829 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6e664def-f0f6-4de9-aafd-3d3e4fa74a98 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:58.495542 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6e664def-f0f6-4de9-aafd-3d3e4fa74a98 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:58.495997 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6e664def-f0f6-4de9-aafd-3d3e4fa74a98 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:58.496423 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6e664def-f0f6-4de9-aafd-3d3e4fa74a98 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:58.747308 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6e664def-f0f6-4de9-aafd-3d3e4fa74a98 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:58.756824 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6e664def-f0f6-4de9-aafd-3d3e4fa74a98 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:58.758444 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6e664def-f0f6-4de9-aafd-3d3e4fa74a98 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:58.759717 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6e664def-f0f6-4de9-aafd-3d3e4fa74a98 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.289679 Aug 17 19:40:58.760264 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 118/225] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:40:58 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:40:58.835973 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0197f30f-fadd-49b7-bf65-323a793a5867 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:58.841746 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:58.842503 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:58.845334 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-0197f30f-fadd-49b7-bf65-323a793a5867 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.436802 Aug 17 19:40:58.845981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 108/226] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:58 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:58.862106 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:58.862590 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:58.863022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:58.863764 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:58.864228 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:58.864683 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:58.895613 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:58.896092 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:58.896522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:58.897349 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.objects.instance [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lazy-loading 'fault' on Instance uuid e387f9d1-6210-4065-a923-4bcb9b92d77b {{(pid=132531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:40:58.941522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:58.948958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-59b1729a-6306-47eb-8764-0099d887e3ec tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 200 len: 1304 microversion: 2.1 time: 0.118754 Aug 17 19:40:58.949541 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 119/227] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:58 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:59.163825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-601ed80c-cfda-45d8-836d-28cccb8f4c90 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:59.164434 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-601ed80c-cfda-45d8-836d-28cccb8f4c90 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:59.170307 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-601ed80c-cfda-45d8-836d-28cccb8f4c90 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:59.170785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-601ed80c-cfda-45d8-836d-28cccb8f4c90 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:59.171218 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-601ed80c-cfda-45d8-836d-28cccb8f4c90 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:59.171951 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-601ed80c-cfda-45d8-836d-28cccb8f4c90 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:59.172404 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-601ed80c-cfda-45d8-836d-28cccb8f4c90 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:59.172822 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-601ed80c-cfda-45d8-836d-28cccb8f4c90 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:59.237582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-402e3c7e-12e9-474e-a5b6-fe34f5fab9b6 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:59.238138 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-402e3c7e-12e9-474e-a5b6-fe34f5fab9b6 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:59.244546 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-402e3c7e-12e9-474e-a5b6-fe34f5fab9b6 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:59.245034 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-402e3c7e-12e9-474e-a5b6-fe34f5fab9b6 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:59.245499 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-402e3c7e-12e9-474e-a5b6-fe34f5fab9b6 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:59.246191 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-402e3c7e-12e9-474e-a5b6-fe34f5fab9b6 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:59.247191 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-402e3c7e-12e9-474e-a5b6-fe34f5fab9b6 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:59.247590 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-402e3c7e-12e9-474e-a5b6-fe34f5fab9b6 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:59.320600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-402e3c7e-12e9-474e-a5b6-fe34f5fab9b6 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:59.330683 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-402e3c7e-12e9-474e-a5b6-fe34f5fab9b6 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1310 microversion: 2.1 time: 0.096892 Aug 17 19:40:59.331683 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 120/228] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:59 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:40:59.334101 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-601ed80c-cfda-45d8-836d-28cccb8f4c90 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:59.350716 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-601ed80c-cfda-45d8-836d-28cccb8f4c90 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1724 microversion: 2.1 time: 0.190579 Aug 17 19:40:59.351325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 109/229] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:59 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:40:59.783750 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-79eaa0e0-d293-4a4d-af1c-fb35d6d90b18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:59.784589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-79eaa0e0-d293-4a4d-af1c-fb35d6d90b18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:59.792837 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-79eaa0e0-d293-4a4d-af1c-fb35d6d90b18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:59.792837 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-79eaa0e0-d293-4a4d-af1c-fb35d6d90b18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:59.792837 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-79eaa0e0-d293-4a4d-af1c-fb35d6d90b18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:59.793067 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-79eaa0e0-d293-4a4d-af1c-fb35d6d90b18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:59.793518 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-79eaa0e0-d293-4a4d-af1c-fb35d6d90b18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:59.794439 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-79eaa0e0-d293-4a4d-af1c-fb35d6d90b18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:59.866463 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-723fce24-3975-411b-b5c1-ad61c3581edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:40:59.867080 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-723fce24-3975-411b-b5c1-ad61c3581edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:40:59.873648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-723fce24-3975-411b-b5c1-ad61c3581edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:59.874333 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-723fce24-3975-411b-b5c1-ad61c3581edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:59.875158 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-723fce24-3975-411b-b5c1-ad61c3581edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:59.875458 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-723fce24-3975-411b-b5c1-ad61c3581edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:40:59.875907 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-723fce24-3975-411b-b5c1-ad61c3581edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:40:59.876625 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-723fce24-3975-411b-b5c1-ad61c3581edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:40:59.970384 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-79eaa0e0-d293-4a4d-af1c-fb35d6d90b18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:59.979247 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-79eaa0e0-d293-4a4d-af1c-fb35d6d90b18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:59.980749 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-79eaa0e0-d293-4a4d-af1c-fb35d6d90b18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:40:59.982776 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-79eaa0e0-d293-4a4d-af1c-fb35d6d90b18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.202934 Aug 17 19:40:59.996943 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 121/230] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:40:59 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:00.001838 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-68cc660d-25a9-4a30-9520-38881a9a5d0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:00.002580 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-68cc660d-25a9-4a30-9520-38881a9a5d0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: e387f9d1-6210-4065-a923-4bcb9b92d77b] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:00.009171 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-68cc660d-25a9-4a30-9520-38881a9a5d0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:00.009699 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-68cc660d-25a9-4a30-9520-38881a9a5d0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:00.010132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-68cc660d-25a9-4a30-9520-38881a9a5d0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:00.010974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-68cc660d-25a9-4a30-9520-38881a9a5d0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:00.011432 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-68cc660d-25a9-4a30-9520-38881a9a5d0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:00.012110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-68cc660d-25a9-4a30-9520-38881a9a5d0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:00.052804 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-723fce24-3975-411b-b5c1-ad61c3581edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:00.056819 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-68cc660d-25a9-4a30-9520-38881a9a5d0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] HTTP exception thrown: Instance e387f9d1-6210-4065-a923-4bcb9b92d77b could not be found. Aug 17 19:41:00.061027 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-723fce24-3975-411b-b5c1-ad61c3581edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.198513 Aug 17 19:41:00.061620 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 110/231] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:59 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-68cc660d-25a9-4a30-9520-38881a9a5d0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Request method failure captured: Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b HTTP/1.1 Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UQwYNRHCpvqHwzl3Rm912xB36VCBS6KfIUNjVqtls3OEuiSBCUOm8xnQNKDQBKZMyr7NnbgXQyLi33wyf_wYueQzqCB8lHrtOIC-Cmd6a-GCk871oRDCzpOsXDVWxJyhILvG6wegSA9uANkXaNPoj6OLfIWkv4rnpmNFTi0ZhXZ2GA Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 12bd76b56a1d4dbcbf306843e0ade6bf Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-VolumesActionsTest-1926207285 Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:41:00.062745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:41:00.064045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/12bd76b56a1d4dbcbf306843e0ade6bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/12bd76b56a1d4dbcbf306843e0ade6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_12bd76b56a1d4dbcbf306843e0ade6bf", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/12bd76b56a1d4dbcbf306843e0ade6bf"}]}] Aug 17 19:41:00.064045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-VolumesActionsTest-1926207285 Aug 17 19:41:00.064045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 12bd76b56a1d4dbcbf306843e0ade6bf Aug 17 19:41:00.064045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-VolumesActionsTest-1926207285 Aug 17 19:41:00.064045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-VolumesActionsTest-1926207285-project Aug 17 19:41:00.064045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:41:00.064045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:41:00.064045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: cc2d61aa2c004363ba15753674123b15 Aug 17 19:41:00.064045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-VolumesActionsTest-1926207285-project Aug 17 19:41:00.064045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:41:00.064045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance e387f9d1-6210-4065-a923-4bcb9b92d77b could not be found. Aug 17 19:41:00.064045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': 'e387f9d1-6210-4065-a923-4bcb9b92d77b'} Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e387f9d1-6210-4065-a923-4bcb9b92d77b could not be found. Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:41:00.064768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e387f9d1-6210-4065-a923-4bcb9b92d77b could not be found. Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e387f9d1-6210-4065-a923-4bcb9b92d77b could not be found. Aug 17 19:41:00.067022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:41:00.071762 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-68cc660d-25a9-4a30-9520-38881a9a5d0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Returning 404 to user: Instance e387f9d1-6210-4065-a923-4bcb9b92d77b could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:41:00.071762 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-68cc660d-25a9-4a30-9520-38881a9a5d0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b" status: 404 len: 111 microversion: 2.1 time: 0.066266 Aug 17 19:41:00.075797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 122/232] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:40:59 2022] GET /compute/v2.1/servers/e387f9d1-6210-4065-a923-4bcb9b92d77b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:41:00.174764 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-561227525", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "networks": [{"uuid": "3017223d-fc3d-422a-acc2-745825634714"}]}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:00.238931 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.network.neutron [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] validate_networks() for [('3017223d-fc3d-422a-acc2-745825634714', None, None, None, None, None)] {{(pid=132530) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:41:00.353666 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f5c2eb4a-63d2-43bd-8ee6-5fe247d9acce tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:00.355032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f5c2eb4a-63d2-43bd-8ee6-5fe247d9acce tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:00.361680 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f5c2eb4a-63d2-43bd-8ee6-5fe247d9acce tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:00.362731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f5c2eb4a-63d2-43bd-8ee6-5fe247d9acce tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:00.363695 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f5c2eb4a-63d2-43bd-8ee6-5fe247d9acce tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:00.364833 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f5c2eb4a-63d2-43bd-8ee6-5fe247d9acce tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:00.365625 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f5c2eb4a-63d2-43bd-8ee6-5fe247d9acce tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:00.366786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f5c2eb4a-63d2-43bd-8ee6-5fe247d9acce tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:00.522257 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f5c2eb4a-63d2-43bd-8ee6-5fe247d9acce tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:00.532531 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f5c2eb4a-63d2-43bd-8ee6-5fe247d9acce tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1316 microversion: 2.1 time: 0.182944 Aug 17 19:41:00.546613 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 123/233] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:00 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:00.552050 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e201932b-ad3b-4029-b228-841127ed565d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:00.553325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e201932b-ad3b-4029-b228-841127ed565d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:00.556416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:00.560647 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e201932b-ad3b-4029-b228-841127ed565d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:00.561444 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e201932b-ad3b-4029-b228-841127ed565d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:00.562109 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e201932b-ad3b-4029-b228-841127ed565d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:00.563010 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e201932b-ad3b-4029-b228-841127ed565d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:00.564068 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e201932b-ad3b-4029-b228-841127ed565d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:00.564883 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e201932b-ad3b-4029-b228-841127ed565d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:00.670216 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Flavor limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:41:00.670640 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Image limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:41:00.671114 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Flavor pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:41:00.671785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Image pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:41:00.672408 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:41:00.683885 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:00.685028 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:00.685726 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:00.686475 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:00.686930 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:00.687546 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:00.707844 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Getting quotas for project 12bd76b56a1d4dbcbf306843e0ade6bf. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:41:00.712758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Getting quotas for user cc2d61aa2c004363ba15753674123b15 and project 12bd76b56a1d4dbcbf306843e0ade6bf. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:41:00.724776 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Going to run 1 instances... {{(pid=132530) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:41:00.727353 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132530) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:41:00.785029 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4d9a2430-9100-432b-a8e2-ad3ac60eb3f0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614284 Aug 17 19:41:00.788267 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 111/234] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:41:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 19:41:00.801766 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-bcdedc99-179e-40af-aa39-37c9f0ba1709 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:00.802701 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-bcdedc99-179e-40af-aa39-37c9f0ba1709 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:00.887310 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-bcdedc99-179e-40af-aa39-37c9f0ba1709 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:00.892464 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e201932b-ad3b-4029-b228-841127ed565d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:00.898896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-bcdedc99-179e-40af-aa39-37c9f0ba1709 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1213 microversion: 2.1 time: 0.103302 Aug 17 19:41:00.899544 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 112/235] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:00 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:00.903282 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e201932b-ad3b-4029-b228-841127ed565d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1724 microversion: 2.1 time: 0.355226 Aug 17 19:41:00.903965 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 124/236] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:00 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:01.005791 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-95e45aeb-d7de-4a5b-96e7-a2dd07a91851 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:01.006653 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-95e45aeb-d7de-4a5b-96e7-a2dd07a91851 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:01.013049 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-95e45aeb-d7de-4a5b-96e7-a2dd07a91851 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:01.013860 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-95e45aeb-d7de-4a5b-96e7-a2dd07a91851 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:01.014474 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-95e45aeb-d7de-4a5b-96e7-a2dd07a91851 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:01.015196 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-95e45aeb-d7de-4a5b-96e7-a2dd07a91851 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:01.015660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-95e45aeb-d7de-4a5b-96e7-a2dd07a91851 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:01.016092 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-95e45aeb-d7de-4a5b-96e7-a2dd07a91851 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:01.086884 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-12772e93-fa57-443a-84e3-b8abcebfb227 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:01.087662 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-12772e93-fa57-443a-84e3-b8abcebfb227 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:01.094599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12772e93-fa57-443a-84e3-b8abcebfb227 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:01.095366 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12772e93-fa57-443a-84e3-b8abcebfb227 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:01.096058 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12772e93-fa57-443a-84e3-b8abcebfb227 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:01.096976 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12772e93-fa57-443a-84e3-b8abcebfb227 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:01.097822 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12772e93-fa57-443a-84e3-b8abcebfb227 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:01.098503 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12772e93-fa57-443a-84e3-b8abcebfb227 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:01.587721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-12772e93-fa57-443a-84e3-b8abcebfb227 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:01.592854 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-95e45aeb-d7de-4a5b-96e7-a2dd07a91851 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:01.596990 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-12772e93-fa57-443a-84e3-b8abcebfb227 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1503 microversion: 2.1 time: 0.514039 Aug 17 19:41:01.597938 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 125/237] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:01 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1503 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:01.602741 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3363d0cc-97eb-4a62-8a17-2c5c6783308b tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:01.603531 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3363d0cc-97eb-4a62-8a17-2c5c6783308b tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:01.606782 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-95e45aeb-d7de-4a5b-96e7-a2dd07a91851 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:01.608431 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-95e45aeb-d7de-4a5b-96e7-a2dd07a91851 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:01.609760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-95e45aeb-d7de-4a5b-96e7-a2dd07a91851 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.607755 Aug 17 19:41:01.610727 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 113/238] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:01 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:01.614806 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3363d0cc-97eb-4a62-8a17-2c5c6783308b tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:01.615292 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3363d0cc-97eb-4a62-8a17-2c5c6783308b tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:01.615725 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3363d0cc-97eb-4a62-8a17-2c5c6783308b tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:01.616609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3363d0cc-97eb-4a62-8a17-2c5c6783308b tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:01.617262 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3363d0cc-97eb-4a62-8a17-2c5c6783308b tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:01.617841 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3363d0cc-97eb-4a62-8a17-2c5c6783308b tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:01.638193 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-89a9e948-b3f2-4c84-8e13-46b3ccc2c485 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac1ae485-8813-4667-b49d-7627a41472e2"}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:01.642619 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-89a9e948-b3f2-4c84-8e13-46b3ccc2c485 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:01.655273 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-89a9e948-b3f2-4c84-8e13-46b3ccc2c485 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:01.655853 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-89a9e948-b3f2-4c84-8e13-46b3ccc2c485 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:01.656574 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-89a9e948-b3f2-4c84-8e13-46b3ccc2c485 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:01.659032 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-89a9e948-b3f2-4c84-8e13-46b3ccc2c485 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:01.659684 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-89a9e948-b3f2-4c84-8e13-46b3ccc2c485 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:01.661133 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-89a9e948-b3f2-4c84-8e13-46b3ccc2c485 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:01.755376 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-89a9e948-b3f2-4c84-8e13-46b3ccc2c485 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] HTTP exception thrown: Cannot 'attach_volume' instance 001bd590-d203-4670-aef3-300aae8d4c4f while it is in vm_state rescued Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-89a9e948-b3f2-4c84-8e13-46b3ccc2c485 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Request method failure captured: Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: POST /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f/os-volume_attachments HTTP/1.1 Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 74 Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPcJwP4Aez04wsbq3OzdbRwjISIv1EoEdHV7G0Tv0BOZhNI_oAYMTTg8jUzGjV7x5yv1317qpWPwanXSDZ2HVJLkJtCsQ1rLkA0WpceWCoQN0d-VsE2IzoNSddrl80YveAfdY-iiqNNDgc8UfuxsbxO5OXL3zP9DrvJm955sOURGpQ Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: 25f3817d99d84da2b797215d23de887f Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:41:01.759702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:41:01.761260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25f3817d99d84da2b797215d23de887f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25f3817d99d84da2b797215d23de887f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25f3817d99d84da2b797215d23de887f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25f3817d99d84da2b797215d23de887f"}]}] Aug 17 19:41:01.761260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:41:01.761260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: 25f3817d99d84da2b797215d23de887f Aug 17 19:41:01.761260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:41:01.761260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-ServerRescueNegativeTestJSON-747820572-project Aug 17 19:41:01.761260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:41:01.761260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:41:01.761260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 608237a0c2704cd3bda98f3724db2528 Aug 17 19:41:01.761260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-ServerRescueNegativeTestJSON-747820572-project Aug 17 19:41:01.761260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Aug 17 19:41:01.761260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {"volumeAttachment": {"volumeId": "ac1ae485-8813-4667-b49d-7627a41472e2"}} Aug 17 19:41:01.761260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Cannot 'attach_volume' instance 001bd590-d203-4670-aef3-300aae8d4c4f while it is in vm_state rescued Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'server_id': '001bd590-d203-4670-aef3-300aae8d4c4f', 'body': {'volumeAttachment': {'volumeId': 'ac1ae485-8813-4667-b49d-7627a41472e2'}}} Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 001bd590-d203-4670-aef3-300aae8d4c4f in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:41:01.762185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 001bd590-d203-4670-aef3-300aae8d4c4f while it is in vm_state rescued Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:41:01.764088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:41:01.765628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:41:01.765628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:41:01.765628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 001bd590-d203-4670-aef3-300aae8d4c4f while it is in vm_state rescued Aug 17 19:41:01.765628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:01.765628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-89a9e948-b3f2-4c84-8e13-46b3ccc2c485 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Returning 409 to user: Cannot 'attach_volume' instance 001bd590-d203-4670-aef3-300aae8d4c4f while it is in vm_state rescued {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:41:01.767104 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-89a9e948-b3f2-4c84-8e13-46b3ccc2c485 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "POST /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.146594 Aug 17 19:41:01.770774 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 114/239] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:41:01 2022] POST /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f/os-volume_attachments => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 19:41:01.786765 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-64f6697e-0a06-47c1-aabe-a3b431a5eaaf tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:01.789140 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-64f6697e-0a06-47c1-aabe-a3b431a5eaaf tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:01.812415 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-64f6697e-0a06-47c1-aabe-a3b431a5eaaf tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:01.815492 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-64f6697e-0a06-47c1-aabe-a3b431a5eaaf tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:01.817433 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-64f6697e-0a06-47c1-aabe-a3b431a5eaaf tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:01.818222 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-64f6697e-0a06-47c1-aabe-a3b431a5eaaf tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:01.819441 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-64f6697e-0a06-47c1-aabe-a3b431a5eaaf tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:01.821973 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-64f6697e-0a06-47c1-aabe-a3b431a5eaaf tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:01.864705 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3363d0cc-97eb-4a62-8a17-2c5c6783308b tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:01.875317 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3363d0cc-97eb-4a62-8a17-2c5c6783308b tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.276031 Aug 17 19:41:01.875905 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 126/240] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:01 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:01.903635 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:01.927353 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-dc514256-6c85-44b7-aaeb-cc8f0494a445 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:01.929397 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-dc514256-6c85-44b7-aaeb-cc8f0494a445 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:01.947018 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dc514256-6c85-44b7-aaeb-cc8f0494a445 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:01.950786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dc514256-6c85-44b7-aaeb-cc8f0494a445 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:01.951866 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dc514256-6c85-44b7-aaeb-cc8f0494a445 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:01.953412 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dc514256-6c85-44b7-aaeb-cc8f0494a445 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:01.954013 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dc514256-6c85-44b7-aaeb-cc8f0494a445 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:01.954706 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dc514256-6c85-44b7-aaeb-cc8f0494a445 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:01.995613 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-64f6697e-0a06-47c1-aabe-a3b431a5eaaf tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "POST /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f/action" status: 202 len: 0 microversion: 2.1 time: 0.221242 Aug 17 19:41:01.996513 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 115/241] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:41:01 2022] POST /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:41:02.014847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e32a829f-cd5a-4dd1-8938-8d92ba32b201 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:02.015564 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e32a829f-cd5a-4dd1-8938-8d92ba32b201 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:02.028675 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e32a829f-cd5a-4dd1-8938-8d92ba32b201 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:02.029361 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e32a829f-cd5a-4dd1-8938-8d92ba32b201 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:02.030871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e32a829f-cd5a-4dd1-8938-8d92ba32b201 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:02.031608 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e32a829f-cd5a-4dd1-8938-8d92ba32b201 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:02.032071 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e32a829f-cd5a-4dd1-8938-8d92ba32b201 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:02.032496 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e32a829f-cd5a-4dd1-8938-8d92ba32b201 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:02.076552 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-dc514256-6c85-44b7-aaeb-cc8f0494a445 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:02.084194 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-dc514256-6c85-44b7-aaeb-cc8f0494a445 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1265 microversion: 2.1 time: 0.167131 Aug 17 19:41:02.085330 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 127/242] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:01 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:02.094919 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-70b96f5f-7352-4df6-9899-1b1539dd421a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:02.095767 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-70b96f5f-7352-4df6-9899-1b1539dd421a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:02.111382 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-70b96f5f-7352-4df6-9899-1b1539dd421a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:02.112085 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-70b96f5f-7352-4df6-9899-1b1539dd421a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:02.112532 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-70b96f5f-7352-4df6-9899-1b1539dd421a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:02.113285 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-70b96f5f-7352-4df6-9899-1b1539dd421a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:02.113742 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-70b96f5f-7352-4df6-9899-1b1539dd421a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:02.114161 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-70b96f5f-7352-4df6-9899-1b1539dd421a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:02.249557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e32a829f-cd5a-4dd1-8938-8d92ba32b201 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:02.259654 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e32a829f-cd5a-4dd1-8938-8d92ba32b201 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1724 microversion: 2.1 time: 0.261585 Aug 17 19:41:02.260474 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 116/243] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:01 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:02.265851 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-7ba0d3de-371d-4fe8-9747-ad2d42bfe048 req-d1d37089-3166-42f8-8980-a026bafb12fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee39152-962e-4cdf-8251-15b138a12dcc", "tag": "b5880430-ff15-4906-82f8-7fe7ec8aba19"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:02.275883 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-7ba0d3de-371d-4fe8-9747-ad2d42bfe048 req-d1d37089-3166-42f8-8980-a026bafb12fa service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:02.276650 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-7ba0d3de-371d-4fe8-9747-ad2d42bfe048 req-d1d37089-3166-42f8-8980-a026bafb12fa service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:02.277076 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-7ba0d3de-371d-4fe8-9747-ad2d42bfe048 req-d1d37089-3166-42f8-8980-a026bafb12fa service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:02.289065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-7ba0d3de-371d-4fe8-9747-ad2d42bfe048 req-d1d37089-3166-42f8-8980-a026bafb12fa service nova] Creating event network-changed:b5880430-ff15-4906-82f8-7fe7ec8aba19 for instance 9ee39152-962e-4cdf-8251-15b138a12dcc on hv-cinder-85069 Aug 17 19:41:02.293200 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-70b96f5f-7352-4df6-9899-1b1539dd421a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:02.294726 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-7ba0d3de-371d-4fe8-9747-ad2d42bfe048 req-d1d37089-3166-42f8-8980-a026bafb12fa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032976 Aug 17 19:41:02.295650 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 117/244] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:02.302426 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-70b96f5f-7352-4df6-9899-1b1539dd421a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1511 microversion: 2.1 time: 0.215838 Aug 17 19:41:02.303286 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 128/245] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:02 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:02.642084 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ebcbd283-13b7-4087-9091-58257b59d606 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:02.642781 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ebcbd283-13b7-4087-9091-58257b59d606 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:02.649334 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ebcbd283-13b7-4087-9091-58257b59d606 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:02.650022 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ebcbd283-13b7-4087-9091-58257b59d606 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:02.650721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ebcbd283-13b7-4087-9091-58257b59d606 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:02.651582 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ebcbd283-13b7-4087-9091-58257b59d606 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:02.652201 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ebcbd283-13b7-4087-9091-58257b59d606 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:02.652923 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ebcbd283-13b7-4087-9091-58257b59d606 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:02.825740 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ebcbd283-13b7-4087-9091-58257b59d606 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:02.837047 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ebcbd283-13b7-4087-9091-58257b59d606 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:02.839546 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ebcbd283-13b7-4087-9091-58257b59d606 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:02.841736 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ebcbd283-13b7-4087-9091-58257b59d606 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.204167 Aug 17 19:41:02.843520 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 118/246] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:02 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:02.896306 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-068eff88-d6b2-4122-b15a-a6a2948cacbf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:02.896925 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-068eff88-d6b2-4122-b15a-a6a2948cacbf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:02.904491 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-068eff88-d6b2-4122-b15a-a6a2948cacbf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:02.905456 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-068eff88-d6b2-4122-b15a-a6a2948cacbf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:02.905456 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-068eff88-d6b2-4122-b15a-a6a2948cacbf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:02.906230 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-068eff88-d6b2-4122-b15a-a6a2948cacbf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:02.906696 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-068eff88-d6b2-4122-b15a-a6a2948cacbf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:02.907124 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-068eff88-d6b2-4122-b15a-a6a2948cacbf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:02.911825 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:03.077859 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-068eff88-d6b2-4122-b15a-a6a2948cacbf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:03.085910 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-068eff88-d6b2-4122-b15a-a6a2948cacbf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.193432 Aug 17 19:41:03.086515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 129/247] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:02 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:03.107252 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c853c5a2-7ab3-4a67-a739-92659d2c1caf tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:03.107844 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c853c5a2-7ab3-4a67-a739-92659d2c1caf tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:03.114457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c853c5a2-7ab3-4a67-a739-92659d2c1caf tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:03.114957 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c853c5a2-7ab3-4a67-a739-92659d2c1caf tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:03.115396 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c853c5a2-7ab3-4a67-a739-92659d2c1caf tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:03.116099 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c853c5a2-7ab3-4a67-a739-92659d2c1caf tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:03.116558 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c853c5a2-7ab3-4a67-a739-92659d2c1caf tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:03.116986 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c853c5a2-7ab3-4a67-a739-92659d2c1caf tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:03.180122 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c853c5a2-7ab3-4a67-a739-92659d2c1caf tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:03.188046 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c853c5a2-7ab3-4a67-a739-92659d2c1caf tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1265 microversion: 2.1 time: 0.085158 Aug 17 19:41:03.188652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 119/248] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:03 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:03.286279 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4f34beb4-84cf-4380-9f9a-d90fa1d9a8f5 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:03.287193 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-4f34beb4-84cf-4380-9f9a-d90fa1d9a8f5 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:03.293648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4f34beb4-84cf-4380-9f9a-d90fa1d9a8f5 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:03.294144 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4f34beb4-84cf-4380-9f9a-d90fa1d9a8f5 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:03.294580 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4f34beb4-84cf-4380-9f9a-d90fa1d9a8f5 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:03.295284 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4f34beb4-84cf-4380-9f9a-d90fa1d9a8f5 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:03.295744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4f34beb4-84cf-4380-9f9a-d90fa1d9a8f5 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:03.296262 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4f34beb4-84cf-4380-9f9a-d90fa1d9a8f5 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:03.328256 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e94aa0e2-7367-4643-b103-3a6f62557887 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:03.329324 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e94aa0e2-7367-4643-b103-3a6f62557887 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:03.331362 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:03.337237 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e94aa0e2-7367-4643-b103-3a6f62557887 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:03.337713 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e94aa0e2-7367-4643-b103-3a6f62557887 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:03.338140 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e94aa0e2-7367-4643-b103-3a6f62557887 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:03.338881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e94aa0e2-7367-4643-b103-3a6f62557887 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:03.339329 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e94aa0e2-7367-4643-b103-3a6f62557887 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:03.339747 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e94aa0e2-7367-4643-b103-3a6f62557887 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:03.495072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4f34beb4-84cf-4380-9f9a-d90fa1d9a8f5 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:03.503013 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-4f34beb4-84cf-4380-9f9a-d90fa1d9a8f5 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1724 microversion: 2.1 time: 0.221565 Aug 17 19:41:03.503961 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 130/249] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:03 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:03.517530 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e94aa0e2-7367-4643-b103-3a6f62557887 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:03.525187 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e94aa0e2-7367-4643-b103-3a6f62557887 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1511 microversion: 2.1 time: 0.202502 Aug 17 19:41:03.525839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 120/250] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:03 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1511 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:03.867786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f877122c-9917-4988-a5df-82fb49275d4d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:03.868338 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f877122c-9917-4988-a5df-82fb49275d4d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:03.874852 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f877122c-9917-4988-a5df-82fb49275d4d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:03.875328 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f877122c-9917-4988-a5df-82fb49275d4d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:03.875760 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f877122c-9917-4988-a5df-82fb49275d4d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:03.876452 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f877122c-9917-4988-a5df-82fb49275d4d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:03.876903 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f877122c-9917-4988-a5df-82fb49275d4d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:03.877349 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f877122c-9917-4988-a5df-82fb49275d4d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:04.039637 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f877122c-9917-4988-a5df-82fb49275d4d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:04.051556 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f877122c-9917-4988-a5df-82fb49275d4d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:04.053099 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f877122c-9917-4988-a5df-82fb49275d4d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:04.054310 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f877122c-9917-4988-a5df-82fb49275d4d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.190989 Aug 17 19:41:04.055175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 131/251] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:03 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:04.107523 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-82068c5a-5f2c-4c27-8f34-1cc02e92f950 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:04.108184 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-82068c5a-5f2c-4c27-8f34-1cc02e92f950 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:04.114960 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-82068c5a-5f2c-4c27-8f34-1cc02e92f950 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:04.115820 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-82068c5a-5f2c-4c27-8f34-1cc02e92f950 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:04.116503 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-82068c5a-5f2c-4c27-8f34-1cc02e92f950 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:04.117555 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-82068c5a-5f2c-4c27-8f34-1cc02e92f950 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:04.118325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-82068c5a-5f2c-4c27-8f34-1cc02e92f950 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:04.119038 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-82068c5a-5f2c-4c27-8f34-1cc02e92f950 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:04.210833 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5189e6a4-0bc9-49b0-bb93-9cc088373bbc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:04.211534 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5189e6a4-0bc9-49b0-bb93-9cc088373bbc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:04.223233 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5189e6a4-0bc9-49b0-bb93-9cc088373bbc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:04.223712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5189e6a4-0bc9-49b0-bb93-9cc088373bbc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:04.224143 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5189e6a4-0bc9-49b0-bb93-9cc088373bbc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:04.224906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5189e6a4-0bc9-49b0-bb93-9cc088373bbc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:04.225321 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5189e6a4-0bc9-49b0-bb93-9cc088373bbc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:04.228922 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5189e6a4-0bc9-49b0-bb93-9cc088373bbc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:04.350065 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5189e6a4-0bc9-49b0-bb93-9cc088373bbc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:04.354133 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-82068c5a-5f2c-4c27-8f34-1cc02e92f950 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:04.363774 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-82068c5a-5f2c-4c27-8f34-1cc02e92f950 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.261180 Aug 17 19:41:04.364352 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 121/252] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:04 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:04.370794 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5189e6a4-0bc9-49b0-bb93-9cc088373bbc tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1265 microversion: 2.1 time: 0.166218 Aug 17 19:41:04.371906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 132/253] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:04 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:04.525143 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-11c573a2-f386-4a90-ba91-f523fceae86c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:04.525791 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-11c573a2-f386-4a90-ba91-f523fceae86c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:04.532440 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-11c573a2-f386-4a90-ba91-f523fceae86c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:04.532922 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-11c573a2-f386-4a90-ba91-f523fceae86c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:04.533391 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-11c573a2-f386-4a90-ba91-f523fceae86c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:04.534079 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-11c573a2-f386-4a90-ba91-f523fceae86c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:04.534535 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-11c573a2-f386-4a90-ba91-f523fceae86c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:04.534963 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-11c573a2-f386-4a90-ba91-f523fceae86c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:04.548188 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-de6b61a8-e15d-4e78-8e73-6a82b22917cc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:04.548797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-de6b61a8-e15d-4e78-8e73-6a82b22917cc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:04.555029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-de6b61a8-e15d-4e78-8e73-6a82b22917cc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:04.555519 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-de6b61a8-e15d-4e78-8e73-6a82b22917cc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:04.555951 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-de6b61a8-e15d-4e78-8e73-6a82b22917cc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:04.556647 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-de6b61a8-e15d-4e78-8e73-6a82b22917cc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:04.557103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-de6b61a8-e15d-4e78-8e73-6a82b22917cc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:04.557561 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-de6b61a8-e15d-4e78-8e73-6a82b22917cc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:04.738773 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-de6b61a8-e15d-4e78-8e73-6a82b22917cc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:04.747485 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-de6b61a8-e15d-4e78-8e73-6a82b22917cc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1511 microversion: 2.1 time: 0.203706 Aug 17 19:41:04.748234 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 133/254] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:04 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:04.770584 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-11c573a2-f386-4a90-ba91-f523fceae86c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:04.786571 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-11c573a2-f386-4a90-ba91-f523fceae86c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1724 microversion: 2.1 time: 0.265103 Aug 17 19:41:04.787233 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 122/255] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:04 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:05.078978 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6800967f-3838-45f3-b969-afefce00099f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:05.079871 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6800967f-3838-45f3-b969-afefce00099f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:05.086727 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6800967f-3838-45f3-b969-afefce00099f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:05.087509 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6800967f-3838-45f3-b969-afefce00099f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:05.088510 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6800967f-3838-45f3-b969-afefce00099f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:05.089625 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6800967f-3838-45f3-b969-afefce00099f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:05.091021 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6800967f-3838-45f3-b969-afefce00099f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:05.091838 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6800967f-3838-45f3-b969-afefce00099f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:05.236573 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6800967f-3838-45f3-b969-afefce00099f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:05.245250 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6800967f-3838-45f3-b969-afefce00099f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:05.247347 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6800967f-3838-45f3-b969-afefce00099f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:05.248596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6800967f-3838-45f3-b969-afefce00099f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.174771 Aug 17 19:41:05.249541 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 134/256] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:05 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:05.391516 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-10b4fe53-27da-46dd-bd56-ac5d7fc1961a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:05.393813 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-7a51ecdb-23e3-4c0f-b373-9cad3659458c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:05.395512 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-10b4fe53-27da-46dd-bd56-ac5d7fc1961a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:05.395974 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-7a51ecdb-23e3-4c0f-b373-9cad3659458c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:05.403581 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7a51ecdb-23e3-4c0f-b373-9cad3659458c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:05.404647 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7a51ecdb-23e3-4c0f-b373-9cad3659458c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:05.405087 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7a51ecdb-23e3-4c0f-b373-9cad3659458c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:05.407695 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-10b4fe53-27da-46dd-bd56-ac5d7fc1961a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:05.408373 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-10b4fe53-27da-46dd-bd56-ac5d7fc1961a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:05.408982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-10b4fe53-27da-46dd-bd56-ac5d7fc1961a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:05.409882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-10b4fe53-27da-46dd-bd56-ac5d7fc1961a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:05.410487 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-10b4fe53-27da-46dd-bd56-ac5d7fc1961a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:05.411067 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-10b4fe53-27da-46dd-bd56-ac5d7fc1961a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:05.413132 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7a51ecdb-23e3-4c0f-b373-9cad3659458c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:05.415244 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7a51ecdb-23e3-4c0f-b373-9cad3659458c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:05.417080 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7a51ecdb-23e3-4c0f-b373-9cad3659458c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:05.494142 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-10b4fe53-27da-46dd-bd56-ac5d7fc1961a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:05.504664 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-10b4fe53-27da-46dd-bd56-ac5d7fc1961a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1265 microversion: 2.1 time: 0.117254 Aug 17 19:41:05.517625 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 135/257] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:05 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1265 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:05.651343 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-7a51ecdb-23e3-4c0f-b373-9cad3659458c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:05.661379 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-7a51ecdb-23e3-4c0f-b373-9cad3659458c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.278049 Aug 17 19:41:05.662696 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 123/258] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:05 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:05.778286 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-7d925d20-51cc-49b9-b086-23f6663aa808 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:05.779146 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-7d925d20-51cc-49b9-b086-23f6663aa808 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:05.794341 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7d925d20-51cc-49b9-b086-23f6663aa808 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:05.795129 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7d925d20-51cc-49b9-b086-23f6663aa808 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:05.795687 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7d925d20-51cc-49b9-b086-23f6663aa808 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:05.796634 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7d925d20-51cc-49b9-b086-23f6663aa808 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:05.797581 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7d925d20-51cc-49b9-b086-23f6663aa808 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:05.798251 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7d925d20-51cc-49b9-b086-23f6663aa808 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:05.818214 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a283dd00-5bcb-4ee6-bc23-92f8b58966f1 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:05.819942 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a283dd00-5bcb-4ee6-bc23-92f8b58966f1 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:05.827630 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a283dd00-5bcb-4ee6-bc23-92f8b58966f1 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:05.828280 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a283dd00-5bcb-4ee6-bc23-92f8b58966f1 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:05.829062 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a283dd00-5bcb-4ee6-bc23-92f8b58966f1 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:05.830251 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a283dd00-5bcb-4ee6-bc23-92f8b58966f1 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:05.830874 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a283dd00-5bcb-4ee6-bc23-92f8b58966f1 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:05.831449 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a283dd00-5bcb-4ee6-bc23-92f8b58966f1 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:06.053992 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-7d925d20-51cc-49b9-b086-23f6663aa808 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:06.064055 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-7d925d20-51cc-49b9-b086-23f6663aa808 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1511 microversion: 2.1 time: 0.299387 Aug 17 19:41:06.081592 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 136/259] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:05 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1511 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:06.091264 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a283dd00-5bcb-4ee6-bc23-92f8b58966f1 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:06.100076 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a283dd00-5bcb-4ee6-bc23-92f8b58966f1 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1724 microversion: 2.1 time: 0.295035 Aug 17 19:41:06.100827 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 124/260] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:05 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:06.271078 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-18cd84d1-1bf3-4b1f-97c6-6b48427d3530 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:06.271922 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-18cd84d1-1bf3-4b1f-97c6-6b48427d3530 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:06.280435 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-18cd84d1-1bf3-4b1f-97c6-6b48427d3530 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:06.280977 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-18cd84d1-1bf3-4b1f-97c6-6b48427d3530 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:06.281443 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-18cd84d1-1bf3-4b1f-97c6-6b48427d3530 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:06.282353 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-18cd84d1-1bf3-4b1f-97c6-6b48427d3530 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:06.282806 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-18cd84d1-1bf3-4b1f-97c6-6b48427d3530 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:06.283233 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-18cd84d1-1bf3-4b1f-97c6-6b48427d3530 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:06.465831 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-18cd84d1-1bf3-4b1f-97c6-6b48427d3530 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:06.473985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-18cd84d1-1bf3-4b1f-97c6-6b48427d3530 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:06.475492 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-18cd84d1-1bf3-4b1f-97c6-6b48427d3530 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:06.476655 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-18cd84d1-1bf3-4b1f-97c6-6b48427d3530 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.209613 Aug 17 19:41:06.481872 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 137/261] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:06 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:06.525594 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-33523e6b-de87-4ac4-ba6d-6b7d96945c07 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:06.526153 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-33523e6b-de87-4ac4-ba6d-6b7d96945c07 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:06.536741 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-33523e6b-de87-4ac4-ba6d-6b7d96945c07 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:06.537367 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-33523e6b-de87-4ac4-ba6d-6b7d96945c07 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:06.537877 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-33523e6b-de87-4ac4-ba6d-6b7d96945c07 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:06.538655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-33523e6b-de87-4ac4-ba6d-6b7d96945c07 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:06.539236 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-33523e6b-de87-4ac4-ba6d-6b7d96945c07 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:06.539724 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-33523e6b-de87-4ac4-ba6d-6b7d96945c07 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:06.607373 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-33523e6b-de87-4ac4-ba6d-6b7d96945c07 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:06.616049 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-33523e6b-de87-4ac4-ba6d-6b7d96945c07 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1265 microversion: 2.1 time: 0.094933 Aug 17 19:41:06.616688 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 125/262] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:06 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:06.687802 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9b873f81-f330-46d4-9a3c-45f34e3e3e15 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:06.688721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9b873f81-f330-46d4-9a3c-45f34e3e3e15 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:06.698093 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9b873f81-f330-46d4-9a3c-45f34e3e3e15 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:06.698093 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9b873f81-f330-46d4-9a3c-45f34e3e3e15 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:06.699029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9b873f81-f330-46d4-9a3c-45f34e3e3e15 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:06.700844 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9b873f81-f330-46d4-9a3c-45f34e3e3e15 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:06.701652 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9b873f81-f330-46d4-9a3c-45f34e3e3e15 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:06.702199 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9b873f81-f330-46d4-9a3c-45f34e3e3e15 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:06.853969 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9b873f81-f330-46d4-9a3c-45f34e3e3e15 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:06.862022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9b873f81-f330-46d4-9a3c-45f34e3e3e15 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.179726 Aug 17 19:41:06.863031 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 138/263] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:06 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:07.088065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f1b3a84e-1135-430b-b8cc-b9403ddee273 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:07.088685 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f1b3a84e-1135-430b-b8cc-b9403ddee273 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:07.099082 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f1b3a84e-1135-430b-b8cc-b9403ddee273 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:07.099519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f1b3a84e-1135-430b-b8cc-b9403ddee273 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:07.099951 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f1b3a84e-1135-430b-b8cc-b9403ddee273 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:07.100653 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f1b3a84e-1135-430b-b8cc-b9403ddee273 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:07.101108 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f1b3a84e-1135-430b-b8cc-b9403ddee273 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:07.101554 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f1b3a84e-1135-430b-b8cc-b9403ddee273 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:07.123848 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c58cf289-79c0-40d8-bd58-51a324fea605 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:07.125565 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-c58cf289-79c0-40d8-bd58-51a324fea605 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:07.131627 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c58cf289-79c0-40d8-bd58-51a324fea605 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:07.132428 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c58cf289-79c0-40d8-bd58-51a324fea605 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:07.136941 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c58cf289-79c0-40d8-bd58-51a324fea605 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:07.138681 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c58cf289-79c0-40d8-bd58-51a324fea605 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:07.142819 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c58cf289-79c0-40d8-bd58-51a324fea605 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:07.143524 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c58cf289-79c0-40d8-bd58-51a324fea605 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:07.364660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f1b3a84e-1135-430b-b8cc-b9403ddee273 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:07.374918 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-c58cf289-79c0-40d8-bd58-51a324fea605 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:07.385296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-c58cf289-79c0-40d8-bd58-51a324fea605 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1724 microversion: 2.1 time: 0.267183 Aug 17 19:41:07.402412 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f1b3a84e-1135-430b-b8cc-b9403ddee273 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1511 microversion: 2.1 time: 0.318059 Aug 17 19:41:07.404232 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 126/264] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:07 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1511 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:07.404647 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 139/265] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:07 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:07.507224 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-31fb7e2a-01ad-4d08-9e8e-5b58a5e72ac7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:07.507985 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-31fb7e2a-01ad-4d08-9e8e-5b58a5e72ac7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:07.517463 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-31fb7e2a-01ad-4d08-9e8e-5b58a5e72ac7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:07.520814 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-31fb7e2a-01ad-4d08-9e8e-5b58a5e72ac7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:07.521662 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-31fb7e2a-01ad-4d08-9e8e-5b58a5e72ac7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:07.523506 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-31fb7e2a-01ad-4d08-9e8e-5b58a5e72ac7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:07.525501 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-31fb7e2a-01ad-4d08-9e8e-5b58a5e72ac7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:07.526235 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-31fb7e2a-01ad-4d08-9e8e-5b58a5e72ac7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:07.647728 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ffff9cbb-925d-43a3-8bd7-df904a573ec2 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:07.648800 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ffff9cbb-925d-43a3-8bd7-df904a573ec2 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:07.671013 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ffff9cbb-925d-43a3-8bd7-df904a573ec2 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:07.672078 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ffff9cbb-925d-43a3-8bd7-df904a573ec2 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:07.672937 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ffff9cbb-925d-43a3-8bd7-df904a573ec2 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:07.673969 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ffff9cbb-925d-43a3-8bd7-df904a573ec2 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:07.674630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ffff9cbb-925d-43a3-8bd7-df904a573ec2 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:07.675492 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ffff9cbb-925d-43a3-8bd7-df904a573ec2 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:07.813517 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-ffff9cbb-925d-43a3-8bd7-df904a573ec2 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:07.823249 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ffff9cbb-925d-43a3-8bd7-df904a573ec2 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1265 microversion: 2.1 time: 0.189607 Aug 17 19:41:07.826448 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 140/266] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:07 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:07.868729 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-31fb7e2a-01ad-4d08-9e8e-5b58a5e72ac7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:07.889666 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-424b2657-fbfd-4001-9d8d-857ec9d5f824 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:07.889923 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-31fb7e2a-01ad-4d08-9e8e-5b58a5e72ac7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:07.890800 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-424b2657-fbfd-4001-9d8d-857ec9d5f824 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:07.891284 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-31fb7e2a-01ad-4d08-9e8e-5b58a5e72ac7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:07.892486 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-31fb7e2a-01ad-4d08-9e8e-5b58a5e72ac7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.390609 Aug 17 19:41:07.897522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-424b2657-fbfd-4001-9d8d-857ec9d5f824 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:07.898257 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-424b2657-fbfd-4001-9d8d-857ec9d5f824 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:07.898860 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-424b2657-fbfd-4001-9d8d-857ec9d5f824 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:07.900074 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-424b2657-fbfd-4001-9d8d-857ec9d5f824 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:07.900806 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-424b2657-fbfd-4001-9d8d-857ec9d5f824 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:07.901411 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-424b2657-fbfd-4001-9d8d-857ec9d5f824 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:07.909077 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 127/267] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:07 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:08.063623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:08.067312 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-424b2657-fbfd-4001-9d8d-857ec9d5f824 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:08.083584 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-424b2657-fbfd-4001-9d8d-857ec9d5f824 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.203670 Aug 17 19:41:08.084166 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 141/268] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:07 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:08.406803 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-07551532-df20-4186-972c-143eefa53baf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:08.407335 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-07551532-df20-4186-972c-143eefa53baf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:08.414262 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-07551532-df20-4186-972c-143eefa53baf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:08.415026 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-07551532-df20-4186-972c-143eefa53baf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:08.415466 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-07551532-df20-4186-972c-143eefa53baf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:08.416175 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-07551532-df20-4186-972c-143eefa53baf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:08.416797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-07551532-df20-4186-972c-143eefa53baf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:08.418913 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-07551532-df20-4186-972c-143eefa53baf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:08.424556 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8ae915a9-0a0c-43e0-b26e-3aa8c13b6316 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:08.425451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-8ae915a9-0a0c-43e0-b26e-3aa8c13b6316 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:08.428316 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=12 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:08.433119 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8ae915a9-0a0c-43e0-b26e-3aa8c13b6316 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:08.433766 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8ae915a9-0a0c-43e0-b26e-3aa8c13b6316 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:08.434806 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8ae915a9-0a0c-43e0-b26e-3aa8c13b6316 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:08.435616 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8ae915a9-0a0c-43e0-b26e-3aa8c13b6316 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:08.436130 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8ae915a9-0a0c-43e0-b26e-3aa8c13b6316 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:08.436623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8ae915a9-0a0c-43e0-b26e-3aa8c13b6316 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:08.637113 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-07551532-df20-4186-972c-143eefa53baf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:08.645521 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-07551532-df20-4186-972c-143eefa53baf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1724 microversion: 2.1 time: 0.242485 Aug 17 19:41:08.646544 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 128/269] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:08 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:08.651257 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8ae915a9-0a0c-43e0-b26e-3aa8c13b6316 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:08.659359 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8ae915a9-0a0c-43e0-b26e-3aa8c13b6316 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1511 microversion: 2.1 time: 0.238922 Aug 17 19:41:08.659902 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 142/270] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:08 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1511 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:08.850696 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ade82a8e-f8de-493d-afaf-d3c349bdb05d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:08.851605 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ade82a8e-f8de-493d-afaf-d3c349bdb05d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:08.860341 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ade82a8e-f8de-493d-afaf-d3c349bdb05d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:08.863959 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ade82a8e-f8de-493d-afaf-d3c349bdb05d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:08.864578 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ade82a8e-f8de-493d-afaf-d3c349bdb05d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:08.865959 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ade82a8e-f8de-493d-afaf-d3c349bdb05d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:08.866635 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ade82a8e-f8de-493d-afaf-d3c349bdb05d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:08.867166 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ade82a8e-f8de-493d-afaf-d3c349bdb05d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:08.924729 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4da1cf85-8b38-47b8-bf25-e711e08cc270 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:08.925683 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-4da1cf85-8b38-47b8-bf25-e711e08cc270 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:08.936931 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4da1cf85-8b38-47b8-bf25-e711e08cc270 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:08.937460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4da1cf85-8b38-47b8-bf25-e711e08cc270 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:08.937955 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4da1cf85-8b38-47b8-bf25-e711e08cc270 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:08.938661 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4da1cf85-8b38-47b8-bf25-e711e08cc270 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:08.939117 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4da1cf85-8b38-47b8-bf25-e711e08cc270 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:08.948167 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4da1cf85-8b38-47b8-bf25-e711e08cc270 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:09.034476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ade82a8e-f8de-493d-afaf-d3c349bdb05d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:09.047268 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ade82a8e-f8de-493d-afaf-d3c349bdb05d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1265 microversion: 2.1 time: 0.204004 Aug 17 19:41:09.060668 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 129/271] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:08 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:09.107544 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-78e71f61-4d66-43fd-9a17-5faf01c52871 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:09.108180 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-78e71f61-4d66-43fd-9a17-5faf01c52871 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:09.117972 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-78e71f61-4d66-43fd-9a17-5faf01c52871 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:09.118751 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-78e71f61-4d66-43fd-9a17-5faf01c52871 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:09.120798 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-78e71f61-4d66-43fd-9a17-5faf01c52871 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:09.121784 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-78e71f61-4d66-43fd-9a17-5faf01c52871 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:09.122247 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-78e71f61-4d66-43fd-9a17-5faf01c52871 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:09.122677 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-78e71f61-4d66-43fd-9a17-5faf01c52871 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:09.238450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4da1cf85-8b38-47b8-bf25-e711e08cc270 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:09.248305 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4da1cf85-8b38-47b8-bf25-e711e08cc270 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:09.252501 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4da1cf85-8b38-47b8-bf25-e711e08cc270 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:09.254093 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-4da1cf85-8b38-47b8-bf25-e711e08cc270 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.341946 Aug 17 19:41:09.279386 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 143/272] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:08 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:09.322413 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-78e71f61-4d66-43fd-9a17-5faf01c52871 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:09.332999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-78e71f61-4d66-43fd-9a17-5faf01c52871 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.230513 Aug 17 19:41:09.346842 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 130/273] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:09 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:09.668957 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4f23434e-df20-43da-85f7-9a261ac9223d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:09.669598 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-4f23434e-df20-43da-85f7-9a261ac9223d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:09.679518 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4f23434e-df20-43da-85f7-9a261ac9223d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:09.680141 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4f23434e-df20-43da-85f7-9a261ac9223d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:09.680478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-cba8923d-c0e6-4f82-b496-4233eeee2c13 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:09.680946 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4f23434e-df20-43da-85f7-9a261ac9223d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:09.681364 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-cba8923d-c0e6-4f82-b496-4233eeee2c13 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:09.681788 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4f23434e-df20-43da-85f7-9a261ac9223d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:09.682537 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4f23434e-df20-43da-85f7-9a261ac9223d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:09.683117 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4f23434e-df20-43da-85f7-9a261ac9223d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:09.695104 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cba8923d-c0e6-4f82-b496-4233eeee2c13 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:09.695744 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cba8923d-c0e6-4f82-b496-4233eeee2c13 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:09.696291 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cba8923d-c0e6-4f82-b496-4233eeee2c13 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:09.697106 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cba8923d-c0e6-4f82-b496-4233eeee2c13 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:09.697694 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cba8923d-c0e6-4f82-b496-4233eeee2c13 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:09.705466 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cba8923d-c0e6-4f82-b496-4233eeee2c13 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:10.025602 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4f23434e-df20-43da-85f7-9a261ac9223d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:10.039603 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-4f23434e-df20-43da-85f7-9a261ac9223d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1724 microversion: 2.1 time: 0.374272 Aug 17 19:41:10.042597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 144/274] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:09 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1724 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:10.072134 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b6491264-4502-4dda-b5b8-e6c35975016f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:10.073135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b6491264-4502-4dda-b5b8-e6c35975016f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:10.090142 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6491264-4502-4dda-b5b8-e6c35975016f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:10.091419 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6491264-4502-4dda-b5b8-e6c35975016f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:10.092748 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6491264-4502-4dda-b5b8-e6c35975016f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:10.094189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6491264-4502-4dda-b5b8-e6c35975016f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:10.096484 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6491264-4502-4dda-b5b8-e6c35975016f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:10.097650 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6491264-4502-4dda-b5b8-e6c35975016f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:10.115710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-cba8923d-c0e6-4f82-b496-4233eeee2c13 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:10.126788 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-cba8923d-c0e6-4f82-b496-4233eeee2c13 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1511 microversion: 2.1 time: 0.450464 Aug 17 19:41:10.146803 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 131/275] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:09 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:10.205402 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b6491264-4502-4dda-b5b8-e6c35975016f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:10.209675 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=100 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:10.219786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b6491264-4502-4dda-b5b8-e6c35975016f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1265 microversion: 2.1 time: 0.155586 Aug 17 19:41:10.229397 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 145/276] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:10 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:10.281880 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2decda55-64c1-4e10-8d10-4754ccbdaefc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:10.282408 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2decda55-64c1-4e10-8d10-4754ccbdaefc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:10.288621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2decda55-64c1-4e10-8d10-4754ccbdaefc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:10.289101 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2decda55-64c1-4e10-8d10-4754ccbdaefc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:10.289564 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2decda55-64c1-4e10-8d10-4754ccbdaefc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:10.290468 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2decda55-64c1-4e10-8d10-4754ccbdaefc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:10.290918 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2decda55-64c1-4e10-8d10-4754ccbdaefc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:10.291344 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2decda55-64c1-4e10-8d10-4754ccbdaefc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:10.294844 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:10.355365 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f523bc68-28f0-4244-86d4-472089276f74 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:10.356795 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f523bc68-28f0-4244-86d4-472089276f74 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:10.364369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f523bc68-28f0-4244-86d4-472089276f74 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:10.364369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f523bc68-28f0-4244-86d4-472089276f74 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:10.364701 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f523bc68-28f0-4244-86d4-472089276f74 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:10.365794 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f523bc68-28f0-4244-86d4-472089276f74 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:10.366360 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f523bc68-28f0-4244-86d4-472089276f74 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:10.366915 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f523bc68-28f0-4244-86d4-472089276f74 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:10.598155 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-2decda55-64c1-4e10-8d10-4754ccbdaefc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:10.606555 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-2decda55-64c1-4e10-8d10-4754ccbdaefc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:10.608061 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-2decda55-64c1-4e10-8d10-4754ccbdaefc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:10.609246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2decda55-64c1-4e10-8d10-4754ccbdaefc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.331272 Aug 17 19:41:10.609803 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 132/277] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:10 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:10.635676 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f523bc68-28f0-4244-86d4-472089276f74 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:10.643308 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f523bc68-28f0-4244-86d4-472089276f74 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.292709 Aug 17 19:41:10.643876 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 146/278] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:10 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:11.068384 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-cabfdc07-eb83-4356-b885-03623aa24c48 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:11.069233 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-cabfdc07-eb83-4356-b885-03623aa24c48 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:11.072827 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:11.073552 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=8 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:11.094248 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cabfdc07-eb83-4356-b885-03623aa24c48 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:11.095164 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cabfdc07-eb83-4356-b885-03623aa24c48 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:11.096504 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cabfdc07-eb83-4356-b885-03623aa24c48 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:11.097670 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cabfdc07-eb83-4356-b885-03623aa24c48 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:11.098285 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cabfdc07-eb83-4356-b885-03623aa24c48 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:11.099006 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cabfdc07-eb83-4356-b885-03623aa24c48 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:11.156000 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8dc17a40-f884-4242-bd91-2e5ff63b57a2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:11.156741 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-8dc17a40-f884-4242-bd91-2e5ff63b57a2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:11.164059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8dc17a40-f884-4242-bd91-2e5ff63b57a2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:11.164540 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8dc17a40-f884-4242-bd91-2e5ff63b57a2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:11.164970 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8dc17a40-f884-4242-bd91-2e5ff63b57a2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:11.165681 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8dc17a40-f884-4242-bd91-2e5ff63b57a2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:11.166128 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8dc17a40-f884-4242-bd91-2e5ff63b57a2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:11.177434 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8dc17a40-f884-4242-bd91-2e5ff63b57a2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:11.430215 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-cabfdc07-eb83-4356-b885-03623aa24c48 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:11.443220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-cabfdc07-eb83-4356-b885-03623aa24c48 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1724 microversion: 2.1 time: 0.379080 Aug 17 19:41:11.443985 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 133/279] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:11 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1724 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:11.457190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3f569098-4ad3-43b1-98cd-3d5b9462da0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:11.462589 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3f569098-4ad3-43b1-98cd-3d5b9462da0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:11.474700 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3f569098-4ad3-43b1-98cd-3d5b9462da0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:11.479094 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8dc17a40-f884-4242-bd91-2e5ff63b57a2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:11.481932 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3f569098-4ad3-43b1-98cd-3d5b9462da0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:11.482385 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3f569098-4ad3-43b1-98cd-3d5b9462da0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:11.483550 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3f569098-4ad3-43b1-98cd-3d5b9462da0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:11.484044 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3f569098-4ad3-43b1-98cd-3d5b9462da0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:11.484827 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3f569098-4ad3-43b1-98cd-3d5b9462da0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:11.493767 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8dc17a40-f884-4242-bd91-2e5ff63b57a2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1511 microversion: 2.1 time: 0.342205 Aug 17 19:41:11.509283 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 147/280] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:11 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1511 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:11.598865 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3f569098-4ad3-43b1-98cd-3d5b9462da0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:11.611032 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3f569098-4ad3-43b1-98cd-3d5b9462da0c tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1283 microversion: 2.1 time: 0.164687 Aug 17 19:41:11.614611 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 134/281] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:11 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1283 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:11.632156 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6db0c2a6-de4c-47f4-8df5-e01764a60e31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:11.632636 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6db0c2a6-de4c-47f4-8df5-e01764a60e31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:11.647672 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6db0c2a6-de4c-47f4-8df5-e01764a60e31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:11.647997 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6db0c2a6-de4c-47f4-8df5-e01764a60e31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:11.648431 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6db0c2a6-de4c-47f4-8df5-e01764a60e31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:11.649129 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6db0c2a6-de4c-47f4-8df5-e01764a60e31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:11.649606 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6db0c2a6-de4c-47f4-8df5-e01764a60e31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:11.650033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6db0c2a6-de4c-47f4-8df5-e01764a60e31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:11.663938 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a8761951-ad3e-45a1-9a42-1640832aea60 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:11.664916 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a8761951-ad3e-45a1-9a42-1640832aea60 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:11.673698 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a8761951-ad3e-45a1-9a42-1640832aea60 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:11.676317 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a8761951-ad3e-45a1-9a42-1640832aea60 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:11.678666 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a8761951-ad3e-45a1-9a42-1640832aea60 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:11.679680 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a8761951-ad3e-45a1-9a42-1640832aea60 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:11.686006 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a8761951-ad3e-45a1-9a42-1640832aea60 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:11.686783 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a8761951-ad3e-45a1-9a42-1640832aea60 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:11.913452 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6db0c2a6-de4c-47f4-8df5-e01764a60e31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:11.927073 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a8761951-ad3e-45a1-9a42-1640832aea60 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:11.931954 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6db0c2a6-de4c-47f4-8df5-e01764a60e31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:11.936907 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6db0c2a6-de4c-47f4-8df5-e01764a60e31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:11.941614 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a8761951-ad3e-45a1-9a42-1640832aea60 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.281425 Aug 17 19:41:11.943161 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6db0c2a6-de4c-47f4-8df5-e01764a60e31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.315068 Aug 17 19:41:11.955983 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 148/282] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:11 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:11.961920 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 135/283] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:11 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:12.467132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8112025e-7e82-40cd-9551-1acc18eaab44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:12.469116 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-8112025e-7e82-40cd-9551-1acc18eaab44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:12.480387 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8112025e-7e82-40cd-9551-1acc18eaab44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:12.481095 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8112025e-7e82-40cd-9551-1acc18eaab44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:12.482066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8112025e-7e82-40cd-9551-1acc18eaab44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:12.483082 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8112025e-7e82-40cd-9551-1acc18eaab44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:12.483871 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8112025e-7e82-40cd-9551-1acc18eaab44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:12.484848 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8112025e-7e82-40cd-9551-1acc18eaab44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:12.519172 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6bbee026-9d1b-47db-a7c9-8adfd2c727d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:12.519712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-6bbee026-9d1b-47db-a7c9-8adfd2c727d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:12.529453 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6bbee026-9d1b-47db-a7c9-8adfd2c727d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:12.530628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6bbee026-9d1b-47db-a7c9-8adfd2c727d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:12.534138 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6bbee026-9d1b-47db-a7c9-8adfd2c727d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:12.535730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6bbee026-9d1b-47db-a7c9-8adfd2c727d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:12.540967 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6bbee026-9d1b-47db-a7c9-8adfd2c727d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:12.541588 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6bbee026-9d1b-47db-a7c9-8adfd2c727d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:12.758550 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8112025e-7e82-40cd-9551-1acc18eaab44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:12.774145 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8112025e-7e82-40cd-9551-1acc18eaab44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1701 microversion: 2.1 time: 0.311929 Aug 17 19:41:12.776027 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 149/284] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:12 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1701 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:12.779896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6bbee026-9d1b-47db-a7c9-8adfd2c727d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:12.788241 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e929917a-e433-4658-8923-f5ca902a4fe0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:12.788753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-6bbee026-9d1b-47db-a7c9-8adfd2c727d8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1511 microversion: 2.1 time: 0.274843 Aug 17 19:41:12.789659 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 136/285] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:12 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1511 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:12.791127 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e929917a-e433-4658-8923-f5ca902a4fe0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:12.800934 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e929917a-e433-4658-8923-f5ca902a4fe0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:12.802048 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e929917a-e433-4658-8923-f5ca902a4fe0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:12.802949 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e929917a-e433-4658-8923-f5ca902a4fe0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:12.803928 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e929917a-e433-4658-8923-f5ca902a4fe0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:12.804844 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e929917a-e433-4658-8923-f5ca902a4fe0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:12.806041 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e929917a-e433-4658-8923-f5ca902a4fe0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:12.811939 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2a2acac4-4ca7-4aba-8410-abd922c3f4e8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:12.826612 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2a2acac4-4ca7-4aba-8410-abd922c3f4e8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:12.827931 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2a2acac4-4ca7-4aba-8410-abd922c3f4e8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:12.828709 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2a2acac4-4ca7-4aba-8410-abd922c3f4e8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:12.874713 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2a2acac4-4ca7-4aba-8410-abd922c3f4e8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Going to try to start instance {{(pid=132530) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 19:41:12.887571 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e929917a-e433-4658-8923-f5ca902a4fe0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:12.897863 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e929917a-e433-4658-8923-f5ca902a4fe0 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1271 microversion: 2.1 time: 0.120561 Aug 17 19:41:12.898436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 150/286] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:12 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:12.948012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2a2acac4-4ca7-4aba-8410-abd922c3f4e8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "POST /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/action" status: 202 len: 0 microversion: 2.1 time: 0.142773 Aug 17 19:41:12.949260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 137/287] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:41:12 2022] POST /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:41:12.962132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-33d5af32-5149-4a8a-ac66-a083c8f419ea tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:12.963236 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-33d5af32-5149-4a8a-ac66-a083c8f419ea tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:12.969912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8e80a080-acdf-4842-8d97-5af5949f06ac tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:12.970616 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-8e80a080-acdf-4842-8d97-5af5949f06ac tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:12.972173 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-33d5af32-5149-4a8a-ac66-a083c8f419ea tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:12.972661 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-33d5af32-5149-4a8a-ac66-a083c8f419ea tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:12.973537 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-33d5af32-5149-4a8a-ac66-a083c8f419ea tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:12.974462 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-33d5af32-5149-4a8a-ac66-a083c8f419ea tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:12.975122 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-33d5af32-5149-4a8a-ac66-a083c8f419ea tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:12.975632 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-33d5af32-5149-4a8a-ac66-a083c8f419ea tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:12.977915 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e80a080-acdf-4842-8d97-5af5949f06ac tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:12.977915 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e80a080-acdf-4842-8d97-5af5949f06ac tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:12.978264 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e80a080-acdf-4842-8d97-5af5949f06ac tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:12.978965 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e80a080-acdf-4842-8d97-5af5949f06ac tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:12.979437 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e80a080-acdf-4842-8d97-5af5949f06ac tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:12.979862 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e80a080-acdf-4842-8d97-5af5949f06ac tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:13.220329 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-33d5af32-5149-4a8a-ac66-a083c8f419ea tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:13.232138 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-33d5af32-5149-4a8a-ac66-a083c8f419ea tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1710 microversion: 2.1 time: 0.277413 Aug 17 19:41:13.233127 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 151/288] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:12 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1710 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:13.237736 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-33ea72f8-e7c9-4935-a71e-89a35bd69a68 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:13.238475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-33ea72f8-e7c9-4935-a71e-89a35bd69a68 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:13.245557 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-33ea72f8-e7c9-4935-a71e-89a35bd69a68 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:13.246072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-33ea72f8-e7c9-4935-a71e-89a35bd69a68 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:13.246584 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-33ea72f8-e7c9-4935-a71e-89a35bd69a68 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:13.247281 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-33ea72f8-e7c9-4935-a71e-89a35bd69a68 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:13.247731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-33ea72f8-e7c9-4935-a71e-89a35bd69a68 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:13.248170 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-33ea72f8-e7c9-4935-a71e-89a35bd69a68 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:13.248280 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8e80a080-acdf-4842-8d97-5af5949f06ac tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:13.259861 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8e80a080-acdf-4842-8d97-5af5949f06ac tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:13.262437 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8e80a080-acdf-4842-8d97-5af5949f06ac tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:13.264304 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8e80a080-acdf-4842-8d97-5af5949f06ac tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.298924 Aug 17 19:41:13.278528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 138/289] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:12 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:41:13.395284 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-33ea72f8-e7c9-4935-a71e-89a35bd69a68 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:13.402516 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-33ea72f8-e7c9-4935-a71e-89a35bd69a68 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.168267 Aug 17 19:41:13.403076 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 152/290] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:13 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:13.812849 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-36526f28-7d74-45e0-82bf-5de4e282ec0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:13.814067 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-36526f28-7d74-45e0-82bf-5de4e282ec0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:13.823034 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-36526f28-7d74-45e0-82bf-5de4e282ec0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:13.823701 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-36526f28-7d74-45e0-82bf-5de4e282ec0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:13.824654 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-36526f28-7d74-45e0-82bf-5de4e282ec0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:13.825838 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-36526f28-7d74-45e0-82bf-5de4e282ec0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:13.826459 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-36526f28-7d74-45e0-82bf-5de4e282ec0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:13.826876 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-36526f28-7d74-45e0-82bf-5de4e282ec0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:13.921897 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-fbcf8299-c9a0-4396-8de7-df21c45aff56 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:13.923132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-fbcf8299-c9a0-4396-8de7-df21c45aff56 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:13.933458 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fbcf8299-c9a0-4396-8de7-df21c45aff56 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:13.941240 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fbcf8299-c9a0-4396-8de7-df21c45aff56 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:13.941707 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fbcf8299-c9a0-4396-8de7-df21c45aff56 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:13.942440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fbcf8299-c9a0-4396-8de7-df21c45aff56 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:13.942900 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fbcf8299-c9a0-4396-8de7-df21c45aff56 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:13.943332 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fbcf8299-c9a0-4396-8de7-df21c45aff56 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:14.373774 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-36526f28-7d74-45e0-82bf-5de4e282ec0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:14.383183 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-36526f28-7d74-45e0-82bf-5de4e282ec0d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1511 microversion: 2.1 time: 0.575731 Aug 17 19:41:14.385890 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 139/291] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:13 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1511 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:14.393494 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-71f4a0b2-a40e-49ca-a349-5daec40e11e7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:14.394544 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-71f4a0b2-a40e-49ca-a349-5daec40e11e7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:14.401600 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-71f4a0b2-a40e-49ca-a349-5daec40e11e7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:14.402224 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-71f4a0b2-a40e-49ca-a349-5daec40e11e7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:14.403235 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-71f4a0b2-a40e-49ca-a349-5daec40e11e7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:14.404207 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-71f4a0b2-a40e-49ca-a349-5daec40e11e7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:14.404680 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-71f4a0b2-a40e-49ca-a349-5daec40e11e7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:14.405105 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-71f4a0b2-a40e-49ca-a349-5daec40e11e7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:14.409824 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-fbcf8299-c9a0-4396-8de7-df21c45aff56 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:14.417731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-fbcf8299-c9a0-4396-8de7-df21c45aff56 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1313 microversion: 2.1 time: 0.500288 Aug 17 19:41:14.422706 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 153/292] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:13 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:14.427587 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-bd9a574c-6236-440b-a766-dcce731d8104 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:14.431447 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-bd9a574c-6236-440b-a766-dcce731d8104 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:14.443593 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bd9a574c-6236-440b-a766-dcce731d8104 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:14.444095 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bd9a574c-6236-440b-a766-dcce731d8104 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:14.444529 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bd9a574c-6236-440b-a766-dcce731d8104 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:14.445247 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bd9a574c-6236-440b-a766-dcce731d8104 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:14.445733 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bd9a574c-6236-440b-a766-dcce731d8104 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:14.446207 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bd9a574c-6236-440b-a766-dcce731d8104 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:14.627749 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-71f4a0b2-a40e-49ca-a349-5daec40e11e7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:14.631034 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-bd9a574c-6236-440b-a766-dcce731d8104 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:14.635938 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-71f4a0b2-a40e-49ca-a349-5daec40e11e7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1710 microversion: 2.1 time: 0.247416 Aug 17 19:41:14.637240 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 140/293] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:14 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1710 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:14.639614 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-bd9a574c-6236-440b-a766-dcce731d8104 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:14.641323 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-bd9a574c-6236-440b-a766-dcce731d8104 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:14.641837 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8112a13e-3804-43a8-8506-05b11f8974bc tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:14.642434 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-8112a13e-3804-43a8-8506-05b11f8974bc tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:14.642541 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-bd9a574c-6236-440b-a766-dcce731d8104 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.218560 Aug 17 19:41:14.653428 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 154/294] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:14 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:14.653428 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-6fa02e35-dc3a-454b-a8fa-e37a9278e602 req-bca70b5c-e9e6-4586-aae5-6a0d51f89cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6b9d664-2c4c-453b-8859-b36d62f08a3a", "tag": "5489f946-7da1-4771-9ff2-0ec4a18c823f"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:14.653712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8112a13e-3804-43a8-8506-05b11f8974bc tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:14.653712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8112a13e-3804-43a8-8506-05b11f8974bc tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:14.653712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8112a13e-3804-43a8-8506-05b11f8974bc tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:14.653712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8112a13e-3804-43a8-8506-05b11f8974bc tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:14.654035 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8112a13e-3804-43a8-8506-05b11f8974bc tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:14.654035 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8112a13e-3804-43a8-8506-05b11f8974bc tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:14.657894 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-6fa02e35-dc3a-454b-a8fa-e37a9278e602 req-bca70b5c-e9e6-4586-aae5-6a0d51f89cea service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:14.658363 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-6fa02e35-dc3a-454b-a8fa-e37a9278e602 req-bca70b5c-e9e6-4586-aae5-6a0d51f89cea service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:14.658789 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-6fa02e35-dc3a-454b-a8fa-e37a9278e602 req-bca70b5c-e9e6-4586-aae5-6a0d51f89cea service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:14.669705 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-6fa02e35-dc3a-454b-a8fa-e37a9278e602 req-bca70b5c-e9e6-4586-aae5-6a0d51f89cea service nova] Creating event network-changed:5489f946-7da1-4771-9ff2-0ec4a18c823f for instance c6b9d664-2c4c-453b-8859-b36d62f08a3a on hv-cinder-85069 Aug 17 19:41:14.674541 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-6fa02e35-dc3a-454b-a8fa-e37a9278e602 req-bca70b5c-e9e6-4586-aae5-6a0d51f89cea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030473 Aug 17 19:41:14.675116 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 155/295] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:14.781395 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8112a13e-3804-43a8-8506-05b11f8974bc tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:14.791440 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8112a13e-3804-43a8-8506-05b11f8974bc tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.153186 Aug 17 19:41:14.792140 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 141/296] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:14 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:14.988656 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1775274618", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:15.040866 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.network.neutron [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] validate_networks() for None {{(pid=132531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:41:15.407420 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ab4e3207-ab24-4976-9ae6-f043ce42d031 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:15.408164 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ab4e3207-ab24-4976-9ae6-f043ce42d031 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:15.418405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab4e3207-ab24-4976-9ae6-f043ce42d031 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:15.418899 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab4e3207-ab24-4976-9ae6-f043ce42d031 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:15.430327 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab4e3207-ab24-4976-9ae6-f043ce42d031 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:15.431097 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab4e3207-ab24-4976-9ae6-f043ce42d031 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:15.431644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab4e3207-ab24-4976-9ae6-f043ce42d031 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:15.432074 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab4e3207-ab24-4976-9ae6-f043ce42d031 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:15.445844 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Flavor limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:41:15.446267 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Image limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:41:15.446751 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Flavor pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:41:15.447169 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Image pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:41:15.447578 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:41:15.466720 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:15.469413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:15.470119 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:15.471106 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:15.472060 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:15.472908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:15.494338 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Getting quotas for project ec6d3773e5384bfdadf6673f61ca5959. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:41:15.498745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Getting quotas for user 6fcb708d5e474aa185615724573e8fe9 and project ec6d3773e5384bfdadf6673f61ca5959. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:41:15.512534 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Going to run 1 instances... {{(pid=132531) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:41:15.515330 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:41:15.592534 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-971ed990-fcfe-4a19-8c03-044edcddcbb3 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608479 Aug 17 19:41:15.595635 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 156/297] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:41:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:41:15.606038 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5148dc8c-4b9d-42b3-9f45-f6849a9b3345 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:15.610180 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5148dc8c-4b9d-42b3-9f45-f6849a9b3345 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:15.617816 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5148dc8c-4b9d-42b3-9f45-f6849a9b3345 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:15.618732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5148dc8c-4b9d-42b3-9f45-f6849a9b3345 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:15.619365 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5148dc8c-4b9d-42b3-9f45-f6849a9b3345 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:15.620531 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5148dc8c-4b9d-42b3-9f45-f6849a9b3345 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:15.621900 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5148dc8c-4b9d-42b3-9f45-f6849a9b3345 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:15.622766 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5148dc8c-4b9d-42b3-9f45-f6849a9b3345 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:15.662951 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ab4e3207-ab24-4976-9ae6-f043ce42d031 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:15.675089 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ab4e3207-ab24-4976-9ae6-f043ce42d031 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1511 microversion: 2.1 time: 0.271734 Aug 17 19:41:15.676075 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 142/298] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:15 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:15.700743 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ce8612f5-a2cf-4cbf-8b6e-410dd709d6b9 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:15.705509 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ce8612f5-a2cf-4cbf-8b6e-410dd709d6b9 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:15.829176 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ce8612f5-a2cf-4cbf-8b6e-410dd709d6b9 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:15.848055 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ce8612f5-a2cf-4cbf-8b6e-410dd709d6b9 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1215 microversion: 2.1 time: 0.169651 Aug 17 19:41:15.851465 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 143/299] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:15 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:15.860943 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1958b4b3-0248-40fb-929a-560a32bdab74 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:15.861595 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1958b4b3-0248-40fb-929a-560a32bdab74 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:15.879324 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1958b4b3-0248-40fb-929a-560a32bdab74 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:15.881742 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1958b4b3-0248-40fb-929a-560a32bdab74 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:15.883276 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1958b4b3-0248-40fb-929a-560a32bdab74 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:15.885521 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1958b4b3-0248-40fb-929a-560a32bdab74 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:15.886341 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1958b4b3-0248-40fb-929a-560a32bdab74 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:15.887820 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1958b4b3-0248-40fb-929a-560a32bdab74 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:15.967586 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5148dc8c-4b9d-42b3-9f45-f6849a9b3345 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:15.992492 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5148dc8c-4b9d-42b3-9f45-f6849a9b3345 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1313 microversion: 2.1 time: 0.387884 Aug 17 19:41:15.993723 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 157/300] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:15 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:16.001613 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8f51c796-5543-4fe8-8364-8aa14cc63de0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:16.007697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-8f51c796-5543-4fe8-8364-8aa14cc63de0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:16.020527 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8f51c796-5543-4fe8-8364-8aa14cc63de0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:16.021373 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8f51c796-5543-4fe8-8364-8aa14cc63de0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:16.022116 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8f51c796-5543-4fe8-8364-8aa14cc63de0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:16.026262 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8f51c796-5543-4fe8-8364-8aa14cc63de0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:16.026985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8f51c796-5543-4fe8-8364-8aa14cc63de0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:16.027857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8f51c796-5543-4fe8-8364-8aa14cc63de0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:16.246712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1958b4b3-0248-40fb-929a-560a32bdab74 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:16.255375 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1958b4b3-0248-40fb-929a-560a32bdab74 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1710 microversion: 2.1 time: 0.402601 Aug 17 19:41:16.256452 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 144/301] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:15 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1710 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:16.262170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d45ab120-3e9e-43ae-9f3e-f4f3136fadf3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:16.262781 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d45ab120-3e9e-43ae-9f3e-f4f3136fadf3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:16.268736 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d45ab120-3e9e-43ae-9f3e-f4f3136fadf3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:16.269230 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d45ab120-3e9e-43ae-9f3e-f4f3136fadf3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:16.269681 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d45ab120-3e9e-43ae-9f3e-f4f3136fadf3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:16.270363 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d45ab120-3e9e-43ae-9f3e-f4f3136fadf3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:16.270816 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d45ab120-3e9e-43ae-9f3e-f4f3136fadf3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:16.271233 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d45ab120-3e9e-43ae-9f3e-f4f3136fadf3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:16.286228 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8f51c796-5543-4fe8-8364-8aa14cc63de0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:16.309191 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8f51c796-5543-4fe8-8364-8aa14cc63de0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:16.311516 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8f51c796-5543-4fe8-8364-8aa14cc63de0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:16.313679 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8f51c796-5543-4fe8-8364-8aa14cc63de0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.315683 Aug 17 19:41:16.314452 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 158/302] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:15 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:16.527928 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d45ab120-3e9e-43ae-9f3e-f4f3136fadf3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:16.536549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d45ab120-3e9e-43ae-9f3e-f4f3136fadf3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.279054 Aug 17 19:41:16.549410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 145/303] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:16 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:16.698750 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-72ae02a5-295b-45aa-9d19-6327092514e4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:16.699315 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-72ae02a5-295b-45aa-9d19-6327092514e4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:16.705502 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-72ae02a5-295b-45aa-9d19-6327092514e4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:16.705990 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-72ae02a5-295b-45aa-9d19-6327092514e4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:16.706427 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-72ae02a5-295b-45aa-9d19-6327092514e4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:16.707125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-72ae02a5-295b-45aa-9d19-6327092514e4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:16.707582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-72ae02a5-295b-45aa-9d19-6327092514e4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:16.708008 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-72ae02a5-295b-45aa-9d19-6327092514e4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:16.834891 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-72ae02a5-295b-45aa-9d19-6327092514e4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:16.843050 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-72ae02a5-295b-45aa-9d19-6327092514e4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1517 microversion: 2.1 time: 0.148278 Aug 17 19:41:16.843616 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 159/304] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:16 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1517 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:16.868901 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-fa74c11b-f7bc-46db-a1f6-1a9d06725d43 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:16.869614 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-fa74c11b-f7bc-46db-a1f6-1a9d06725d43 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:16.875571 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa74c11b-f7bc-46db-a1f6-1a9d06725d43 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:16.876668 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa74c11b-f7bc-46db-a1f6-1a9d06725d43 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:16.877107 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa74c11b-f7bc-46db-a1f6-1a9d06725d43 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:16.877825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa74c11b-f7bc-46db-a1f6-1a9d06725d43 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:16.878275 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa74c11b-f7bc-46db-a1f6-1a9d06725d43 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:16.878691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa74c11b-f7bc-46db-a1f6-1a9d06725d43 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:16.948063 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-fa74c11b-f7bc-46db-a1f6-1a9d06725d43 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:16.957098 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-fa74c11b-f7bc-46db-a1f6-1a9d06725d43 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1267 microversion: 2.1 time: 0.091830 Aug 17 19:41:16.958216 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 146/305] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:16 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:17.016251 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-12928157-88bb-4375-bfc1-480928b4eb3f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:17.017141 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-12928157-88bb-4375-bfc1-480928b4eb3f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:17.024001 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12928157-88bb-4375-bfc1-480928b4eb3f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:17.024429 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12928157-88bb-4375-bfc1-480928b4eb3f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:17.025089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12928157-88bb-4375-bfc1-480928b4eb3f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:17.025901 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12928157-88bb-4375-bfc1-480928b4eb3f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:17.026556 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12928157-88bb-4375-bfc1-480928b4eb3f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:17.027940 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12928157-88bb-4375-bfc1-480928b4eb3f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:17.236698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-12928157-88bb-4375-bfc1-480928b4eb3f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:17.246947 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-12928157-88bb-4375-bfc1-480928b4eb3f tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1313 microversion: 2.1 time: 0.234782 Aug 17 19:41:17.247766 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 160/306] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:17 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:17.277077 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-99f4226a-f2fc-4b1d-b409-075dd65b9f2f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:17.277804 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-99f4226a-f2fc-4b1d-b409-075dd65b9f2f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:17.287087 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-99f4226a-f2fc-4b1d-b409-075dd65b9f2f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:17.287698 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-99f4226a-f2fc-4b1d-b409-075dd65b9f2f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:17.288247 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-99f4226a-f2fc-4b1d-b409-075dd65b9f2f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:17.289317 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-99f4226a-f2fc-4b1d-b409-075dd65b9f2f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:17.290118 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-99f4226a-f2fc-4b1d-b409-075dd65b9f2f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:17.292181 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-99f4226a-f2fc-4b1d-b409-075dd65b9f2f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:17.339442 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d74977d6-1196-46d5-8055-3c18b2a96607 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:17.340085 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d74977d6-1196-46d5-8055-3c18b2a96607 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:17.351173 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d74977d6-1196-46d5-8055-3c18b2a96607 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:17.351665 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d74977d6-1196-46d5-8055-3c18b2a96607 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:17.352118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d74977d6-1196-46d5-8055-3c18b2a96607 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:17.352900 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d74977d6-1196-46d5-8055-3c18b2a96607 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:17.353381 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d74977d6-1196-46d5-8055-3c18b2a96607 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:17.353802 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d74977d6-1196-46d5-8055-3c18b2a96607 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:17.520385 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-99f4226a-f2fc-4b1d-b409-075dd65b9f2f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:17.532069 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-99f4226a-f2fc-4b1d-b409-075dd65b9f2f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1710 microversion: 2.1 time: 0.259623 Aug 17 19:41:17.532664 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 147/307] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:17 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1710 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:17.559581 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-bd1fcab3-61ff-4b61-bd08-74b84a47e26a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:17.560695 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-bd1fcab3-61ff-4b61-bd08-74b84a47e26a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:17.580244 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bd1fcab3-61ff-4b61-bd08-74b84a47e26a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:17.581060 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bd1fcab3-61ff-4b61-bd08-74b84a47e26a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:17.583865 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bd1fcab3-61ff-4b61-bd08-74b84a47e26a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:17.584977 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bd1fcab3-61ff-4b61-bd08-74b84a47e26a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:17.586888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bd1fcab3-61ff-4b61-bd08-74b84a47e26a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:17.587402 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bd1fcab3-61ff-4b61-bd08-74b84a47e26a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:17.628394 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d74977d6-1196-46d5-8055-3c18b2a96607 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:17.641300 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d74977d6-1196-46d5-8055-3c18b2a96607 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:17.642815 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d74977d6-1196-46d5-8055-3c18b2a96607 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:17.650052 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d74977d6-1196-46d5-8055-3c18b2a96607 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1743 microversion: 2.20 time: 0.314436 Aug 17 19:41:17.650983 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 161/308] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:17 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1743 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:17.657428 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-26c8999c-9b1f-4eea-867d-9a4139642c8f req-260bb016-c5b9-4663-93fe-bcfbe19c7e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee39152-962e-4cdf-8251-15b138a12dcc", "name": "network-vif-plugged", "status": "completed", "tag": "b5880430-ff15-4906-82f8-7fe7ec8aba19"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:17.682673 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-26c8999c-9b1f-4eea-867d-9a4139642c8f req-260bb016-c5b9-4663-93fe-bcfbe19c7e01 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:17.683165 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-26c8999c-9b1f-4eea-867d-9a4139642c8f req-260bb016-c5b9-4663-93fe-bcfbe19c7e01 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:17.687278 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-26c8999c-9b1f-4eea-867d-9a4139642c8f req-260bb016-c5b9-4663-93fe-bcfbe19c7e01 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:17.705527 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-26c8999c-9b1f-4eea-867d-9a4139642c8f req-260bb016-c5b9-4663-93fe-bcfbe19c7e01 service nova] Creating event network-vif-plugged:b5880430-ff15-4906-82f8-7fe7ec8aba19 for instance 9ee39152-962e-4cdf-8251-15b138a12dcc on hv-cinder-85069 Aug 17 19:41:17.712408 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-26c8999c-9b1f-4eea-867d-9a4139642c8f req-260bb016-c5b9-4663-93fe-bcfbe19c7e01 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060084 Aug 17 19:41:17.713384 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 162/309] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:17.835417 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-bd1fcab3-61ff-4b61-bd08-74b84a47e26a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:17.838685 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:17.851309 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-bd1fcab3-61ff-4b61-bd08-74b84a47e26a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.296005 Aug 17 19:41:17.854044 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 148/310] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:17 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:17.985923 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9fb20c12-4b03-4bb7-9597-744c0989c62e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:17.986595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9fb20c12-4b03-4bb7-9597-744c0989c62e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:17.997053 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fb20c12-4b03-4bb7-9597-744c0989c62e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:17.998921 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fb20c12-4b03-4bb7-9597-744c0989c62e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:17.999546 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fb20c12-4b03-4bb7-9597-744c0989c62e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:18.000947 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fb20c12-4b03-4bb7-9597-744c0989c62e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:18.002490 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fb20c12-4b03-4bb7-9597-744c0989c62e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:18.003104 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fb20c12-4b03-4bb7-9597-744c0989c62e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:18.083180 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9fb20c12-4b03-4bb7-9597-744c0989c62e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:18.092501 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9fb20c12-4b03-4bb7-9597-744c0989c62e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1273 microversion: 2.1 time: 0.116168 Aug 17 19:41:18.093398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 163/311] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:17 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:18.257477 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e0180839-d24c-49fb-8601-934ca0cea74f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Action: 'create', calling method: .version_select at 0x7f368a373af0>, body: {"keypair": {"name": "tempest-keypair-1862731004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT1vUSfiXXOoeJo8proM0hV+exO2YLcPWQO6/PPA1yRx6JLcUMa3RphEyoDQ6VOa2ogPEBIFAPAyxDZ8yXe+uHo1CweguxY3Illh9UBVFk/W25ZtUwChnAPfQLtSy4iDg=="}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:18.267770 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-433615b0-cf85-46a7-bce3-62552c395002 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:18.268407 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-433615b0-cf85-46a7-bce3-62552c395002 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:18.278717 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-433615b0-cf85-46a7-bce3-62552c395002 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:18.279123 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-433615b0-cf85-46a7-bce3-62552c395002 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:18.279564 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-433615b0-cf85-46a7-bce3-62552c395002 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:18.280282 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-433615b0-cf85-46a7-bce3-62552c395002 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:18.280742 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-433615b0-cf85-46a7-bce3-62552c395002 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:18.281091 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-e0180839-d24c-49fb-8601-934ca0cea74f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Getting quotas for project 25f3817d99d84da2b797215d23de887f. Resources: {'key_pairs'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:41:18.281299 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-433615b0-cf85-46a7-bce3-62552c395002 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:18.288614 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-e0180839-d24c-49fb-8601-934ca0cea74f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Getting quotas for user 608237a0c2704cd3bda98f3724db2528 and project 25f3817d99d84da2b797215d23de887f. Resources: {'key_pairs'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:41:18.301005 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=100 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:18.322556 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e0180839-d24c-49fb-8601-934ca0cea74f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.069659 Aug 17 19:41:18.323938 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 149/312] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 17 19:41:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:18.546340 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-433615b0-cf85-46a7-bce3-62552c395002 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:18.556625 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-433615b0-cf85-46a7-bce3-62552c395002 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1313 microversion: 2.1 time: 0.292541 Aug 17 19:41:18.560404 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5aab65e5-2bb6-4421-8f4f-e7db9a390d43 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:18.561662 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5aab65e5-2bb6-4421-8f4f-e7db9a390d43 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:18.571100 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 164/313] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:18 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:18.580950 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5aab65e5-2bb6-4421-8f4f-e7db9a390d43 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:18.582213 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5aab65e5-2bb6-4421-8f4f-e7db9a390d43 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:18.582992 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5aab65e5-2bb6-4421-8f4f-e7db9a390d43 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:18.583931 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5aab65e5-2bb6-4421-8f4f-e7db9a390d43 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:18.600002 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5aab65e5-2bb6-4421-8f4f-e7db9a390d43 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:18.602020 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5aab65e5-2bb6-4421-8f4f-e7db9a390d43 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:18.675681 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f636770e-962d-4d3c-afcf-9611ae50bfbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:18.676297 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f636770e-962d-4d3c-afcf-9611ae50bfbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:18.683952 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f636770e-962d-4d3c-afcf-9611ae50bfbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:18.683952 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f636770e-962d-4d3c-afcf-9611ae50bfbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:18.684367 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f636770e-962d-4d3c-afcf-9611ae50bfbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:18.685342 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f636770e-962d-4d3c-afcf-9611ae50bfbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:18.685799 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f636770e-962d-4d3c-afcf-9611ae50bfbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:18.686647 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f636770e-962d-4d3c-afcf-9611ae50bfbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:18.865079 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5aab65e5-2bb6-4421-8f4f-e7db9a390d43 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:18.875403 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5aab65e5-2bb6-4421-8f4f-e7db9a390d43 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1714 microversion: 2.1 time: 0.321156 Aug 17 19:41:18.876068 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 150/314] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:18 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1714 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:18.885777 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d4b14ff9-94d4-439b-b61c-caf3efebb577 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:18.887962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d4b14ff9-94d4-439b-b61c-caf3efebb577 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:18.895918 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d4b14ff9-94d4-439b-b61c-caf3efebb577 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:18.896442 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d4b14ff9-94d4-439b-b61c-caf3efebb577 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:18.896881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d4b14ff9-94d4-439b-b61c-caf3efebb577 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:18.898313 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d4b14ff9-94d4-439b-b61c-caf3efebb577 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:18.898831 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d4b14ff9-94d4-439b-b61c-caf3efebb577 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:18.899264 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d4b14ff9-94d4-439b-b61c-caf3efebb577 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:18.931438 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f636770e-962d-4d3c-afcf-9611ae50bfbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:18.940983 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f636770e-962d-4d3c-afcf-9611ae50bfbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:18.942777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f636770e-962d-4d3c-afcf-9611ae50bfbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:18.944152 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f636770e-962d-4d3c-afcf-9611ae50bfbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1743 microversion: 2.20 time: 0.273954 Aug 17 19:41:18.965628 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 165/315] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:18 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1743 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:41:19.115962 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6bd86e10-44ad-4447-87ac-e6ebc327b58a tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:19.116623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6bd86e10-44ad-4447-87ac-e6ebc327b58a tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:19.124255 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6bd86e10-44ad-4447-87ac-e6ebc327b58a tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:19.124839 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6bd86e10-44ad-4447-87ac-e6ebc327b58a tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:19.125376 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6bd86e10-44ad-4447-87ac-e6ebc327b58a tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:19.126151 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6bd86e10-44ad-4447-87ac-e6ebc327b58a tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:19.126694 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6bd86e10-44ad-4447-87ac-e6ebc327b58a tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:19.127316 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6bd86e10-44ad-4447-87ac-e6ebc327b58a tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:19.355000 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d4b14ff9-94d4-439b-b61c-caf3efebb577 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:19.367786 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d4b14ff9-94d4-439b-b61c-caf3efebb577 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.488973 Aug 17 19:41:19.370614 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 151/316] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:18 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:19.432848 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6bd86e10-44ad-4447-87ac-e6ebc327b58a tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:19.443994 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6bd86e10-44ad-4447-87ac-e6ebc327b58a tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1315 microversion: 2.1 time: 0.332175 Aug 17 19:41:19.460498 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 166/317] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:19 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:19.579037 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f185adb0-d58b-48a2-a4ed-9766290764c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:19.579684 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f185adb0-d58b-48a2-a4ed-9766290764c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:19.592235 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f185adb0-d58b-48a2-a4ed-9766290764c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:19.593281 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f185adb0-d58b-48a2-a4ed-9766290764c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:19.593442 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f185adb0-d58b-48a2-a4ed-9766290764c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:19.594397 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f185adb0-d58b-48a2-a4ed-9766290764c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:19.594995 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f185adb0-d58b-48a2-a4ed-9766290764c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:19.596219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f185adb0-d58b-48a2-a4ed-9766290764c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:19.827466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-b700176d-2a5e-4088-b81d-48cf445f71e4 req-60f311fe-2192-4a1e-88c1-e59e56ff7cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93ae0457-5029-49a2-9182-4124ba6b015f", "tag": "6c9849e7-051b-4d58-899b-fcadcef2f78d"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:19.832084 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f185adb0-d58b-48a2-a4ed-9766290764c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:19.845587 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f185adb0-d58b-48a2-a4ed-9766290764c6 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1313 microversion: 2.1 time: 0.270130 Aug 17 19:41:19.846175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:19.848260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-b700176d-2a5e-4088-b81d-48cf445f71e4 req-60f311fe-2192-4a1e-88c1-e59e56ff7cd1 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:19.848913 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-b700176d-2a5e-4088-b81d-48cf445f71e4 req-60f311fe-2192-4a1e-88c1-e59e56ff7cd1 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:19.849525 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-b700176d-2a5e-4088-b81d-48cf445f71e4 req-60f311fe-2192-4a1e-88c1-e59e56ff7cd1 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:19.860990 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-b700176d-2a5e-4088-b81d-48cf445f71e4 req-60f311fe-2192-4a1e-88c1-e59e56ff7cd1 service nova] Creating event network-changed:6c9849e7-051b-4d58-899b-fcadcef2f78d for instance 93ae0457-5029-49a2-9182-4124ba6b015f on hv-cinder-85069 Aug 17 19:41:19.861937 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 152/318] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:19 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:19.866746 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-b700176d-2a5e-4088-b81d-48cf445f71e4 req-60f311fe-2192-4a1e-88c1-e59e56ff7cd1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043757 Aug 17 19:41:19.867332 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 167/319] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:41:19.978363 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1134b7c6-9f75-4e3e-ae99-b7bfe6affbc0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:19.978974 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1134b7c6-9f75-4e3e-ae99-b7bfe6affbc0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:19.984957 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1134b7c6-9f75-4e3e-ae99-b7bfe6affbc0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:19.985498 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1134b7c6-9f75-4e3e-ae99-b7bfe6affbc0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:19.985935 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1134b7c6-9f75-4e3e-ae99-b7bfe6affbc0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:19.986624 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1134b7c6-9f75-4e3e-ae99-b7bfe6affbc0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:19.987081 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1134b7c6-9f75-4e3e-ae99-b7bfe6affbc0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:19.987503 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1134b7c6-9f75-4e3e-ae99-b7bfe6affbc0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:20.182219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1134b7c6-9f75-4e3e-ae99-b7bfe6affbc0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:20.190667 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1134b7c6-9f75-4e3e-ae99-b7bfe6affbc0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:20.192255 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1134b7c6-9f75-4e3e-ae99-b7bfe6affbc0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:20.193498 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1134b7c6-9f75-4e3e-ae99-b7bfe6affbc0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1743 microversion: 2.20 time: 0.219032 Aug 17 19:41:20.194629 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 153/320] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:19 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1743 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:41:20.393270 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6150a9a2-853c-4efe-ae1b-86434fdb8213 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:20.394623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6150a9a2-853c-4efe-ae1b-86434fdb8213 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:20.401704 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6150a9a2-853c-4efe-ae1b-86434fdb8213 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:20.402309 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6150a9a2-853c-4efe-ae1b-86434fdb8213 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:20.402836 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6150a9a2-853c-4efe-ae1b-86434fdb8213 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:20.403723 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6150a9a2-853c-4efe-ae1b-86434fdb8213 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:20.404352 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6150a9a2-853c-4efe-ae1b-86434fdb8213 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:20.404930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6150a9a2-853c-4efe-ae1b-86434fdb8213 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:20.465282 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b2601b51-f63a-48f4-ade9-2d70c0414d39 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:20.465888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b2601b51-f63a-48f4-ade9-2d70c0414d39 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:20.472458 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b2601b51-f63a-48f4-ade9-2d70c0414d39 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:20.472935 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b2601b51-f63a-48f4-ade9-2d70c0414d39 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:20.473391 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b2601b51-f63a-48f4-ade9-2d70c0414d39 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:20.474455 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b2601b51-f63a-48f4-ade9-2d70c0414d39 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:20.474905 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b2601b51-f63a-48f4-ade9-2d70c0414d39 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:20.475312 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b2601b51-f63a-48f4-ade9-2d70c0414d39 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:20.618632 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6150a9a2-853c-4efe-ae1b-86434fdb8213 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:20.626644 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6150a9a2-853c-4efe-ae1b-86434fdb8213 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.238553 Aug 17 19:41:20.627213 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 168/321] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:20 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:20.632434 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1226540795", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e5255586-eadf-4699-a0a6-becc090592e0"}], "security_groups": [{"name": "tempest-securitygroup--1203899643"}], "key_name": "tempest-keypair-1862731004", "user_data": "}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:20.647719 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b2601b51-f63a-48f4-ade9-2d70c0414d39 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:20.655334 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b2601b51-f63a-48f4-ade9-2d70c0414d39 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1315 microversion: 2.1 time: 0.193930 Aug 17 19:41:20.655883 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 154/322] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:20 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:20.733127 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.network.neutron [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] validate_networks() for [('e5255586-eadf-4699-a0a6-becc090592e0', None, None, None, None, None)] {{(pid=132531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:41:20.866864 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e116d8cd-d842-436e-8cbd-4aa6284e6617 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:20.867471 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e116d8cd-d842-436e-8cbd-4aa6284e6617 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:20.873833 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e116d8cd-d842-436e-8cbd-4aa6284e6617 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:20.874321 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e116d8cd-d842-436e-8cbd-4aa6284e6617 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:20.874752 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e116d8cd-d842-436e-8cbd-4aa6284e6617 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:20.875449 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e116d8cd-d842-436e-8cbd-4aa6284e6617 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:20.875893 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e116d8cd-d842-436e-8cbd-4aa6284e6617 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:20.876312 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e116d8cd-d842-436e-8cbd-4aa6284e6617 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:21.111863 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e116d8cd-d842-436e-8cbd-4aa6284e6617 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:21.119545 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e116d8cd-d842-436e-8cbd-4aa6284e6617 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1313 microversion: 2.1 time: 0.256427 Aug 17 19:41:21.120121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 155/323] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:20 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:21.187088 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Flavor limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:41:21.187510 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Image limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:41:21.188054 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Flavor pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:41:21.188470 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Image pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:41:21.188881 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:41:21.197783 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:21.198266 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:21.198703 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:21.199466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:21.199922 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:21.200613 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:21.218378 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a21d1b70-3e57-4df1-ac2a-7ec41257a18b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:21.218995 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a21d1b70-3e57-4df1-ac2a-7ec41257a18b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:21.219397 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Getting quotas for project 25f3817d99d84da2b797215d23de887f. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:41:21.223647 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Getting quotas for user 608237a0c2704cd3bda98f3724db2528 and project 25f3817d99d84da2b797215d23de887f. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:41:21.225896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a21d1b70-3e57-4df1-ac2a-7ec41257a18b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:21.226384 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a21d1b70-3e57-4df1-ac2a-7ec41257a18b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:21.226813 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a21d1b70-3e57-4df1-ac2a-7ec41257a18b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:21.227501 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a21d1b70-3e57-4df1-ac2a-7ec41257a18b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:21.227980 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a21d1b70-3e57-4df1-ac2a-7ec41257a18b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:21.228393 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a21d1b70-3e57-4df1-ac2a-7ec41257a18b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:21.236444 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Going to run 1 instances... {{(pid=132531) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:41:21.238757 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:41:21.288724 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-afe36b41-099d-4e8c-a67d-b3bf970dbf15 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.660296 Aug 17 19:41:21.289593 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 169/324] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:41:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:41:21.303212 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-eba3ae96-0b1f-4e4a-b95a-7d23906953be tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:21.304655 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-eba3ae96-0b1f-4e4a-b95a-7d23906953be tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:21.441022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-eba3ae96-0b1f-4e4a-b95a-7d23906953be tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:21.452053 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a21d1b70-3e57-4df1-ac2a-7ec41257a18b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:21.452484 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-eba3ae96-0b1f-4e4a-b95a-7d23906953be tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1246 microversion: 2.1 time: 0.155208 Aug 17 19:41:21.465243 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 170/325] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:21 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1246 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:21.470384 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a21d1b70-3e57-4df1-ac2a-7ec41257a18b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:21.472512 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a21d1b70-3e57-4df1-ac2a-7ec41257a18b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:21.473734 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a21d1b70-3e57-4df1-ac2a-7ec41257a18b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1738 microversion: 2.20 time: 0.260684 Aug 17 19:41:21.476185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 156/326] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:21 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:21.654665 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5da17ef7-9ba8-463a-9153-bea7231b37ec tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:21.654896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-8ab14c81-9d8b-493e-9552-7238f2c6ab0c req-3408dd0a-8031-411d-adf1-6bf84e4f840f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04daa67-36a6-4a53-b80a-e90f77348028", "name": "network-vif-plugged", "status": "completed", "tag": "8692c85c-fc9f-49cd-bff2-6ddd975dd053"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:21.656224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5da17ef7-9ba8-463a-9153-bea7231b37ec tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:21.668465 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5da17ef7-9ba8-463a-9153-bea7231b37ec tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:21.669503 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5da17ef7-9ba8-463a-9153-bea7231b37ec tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:21.672042 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5da17ef7-9ba8-463a-9153-bea7231b37ec tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:21.673779 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5da17ef7-9ba8-463a-9153-bea7231b37ec tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:21.676031 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5da17ef7-9ba8-463a-9153-bea7231b37ec tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:21.676829 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5da17ef7-9ba8-463a-9153-bea7231b37ec tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:21.677204 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-8ab14c81-9d8b-493e-9552-7238f2c6ab0c req-3408dd0a-8031-411d-adf1-6bf84e4f840f service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:21.677743 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-8ab14c81-9d8b-493e-9552-7238f2c6ab0c req-3408dd0a-8031-411d-adf1-6bf84e4f840f service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:21.678177 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-8ab14c81-9d8b-493e-9552-7238f2c6ab0c req-3408dd0a-8031-411d-adf1-6bf84e4f840f service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:21.703128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-8ab14c81-9d8b-493e-9552-7238f2c6ab0c req-3408dd0a-8031-411d-adf1-6bf84e4f840f service nova] Creating event network-vif-plugged:8692c85c-fc9f-49cd-bff2-6ddd975dd053 for instance b04daa67-36a6-4a53-b80a-e90f77348028 on hv-cinder-85069 Aug 17 19:41:21.715267 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-8ab14c81-9d8b-493e-9552-7238f2c6ab0c req-3408dd0a-8031-411d-adf1-6bf84e4f840f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064691 Aug 17 19:41:21.717960 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 157/327] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:41:21.731842 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8bec125e-b4f4-431f-8bf1-d26362d540ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:21.732857 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-8bec125e-b4f4-431f-8bf1-d26362d540ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:21.746802 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8bec125e-b4f4-431f-8bf1-d26362d540ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:21.747632 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8bec125e-b4f4-431f-8bf1-d26362d540ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:21.750336 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8bec125e-b4f4-431f-8bf1-d26362d540ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:21.754520 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8bec125e-b4f4-431f-8bf1-d26362d540ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:21.755254 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8bec125e-b4f4-431f-8bf1-d26362d540ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:21.756386 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8bec125e-b4f4-431f-8bf1-d26362d540ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:22.039063 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8bec125e-b4f4-431f-8bf1-d26362d540ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:22.047908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8bec125e-b4f4-431f-8bf1-d26362d540ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1315 microversion: 2.1 time: 0.328537 Aug 17 19:41:22.052170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 158/328] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:21 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:22.072613 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5da17ef7-9ba8-463a-9153-bea7231b37ec tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:22.083286 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5da17ef7-9ba8-463a-9153-bea7231b37ec tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1358 microversion: 2.1 time: 0.439417 Aug 17 19:41:22.083870 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 171/329] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:21 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1358 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:22.141433 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-12be6e18-a2f9-4533-baae-3108bc290604 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:22.142041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-12be6e18-a2f9-4533-baae-3108bc290604 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:22.148043 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-12be6e18-a2f9-4533-baae-3108bc290604 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:22.148563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-12be6e18-a2f9-4533-baae-3108bc290604 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:22.148994 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-12be6e18-a2f9-4533-baae-3108bc290604 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:22.149729 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-12be6e18-a2f9-4533-baae-3108bc290604 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:22.150355 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-12be6e18-a2f9-4533-baae-3108bc290604 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:22.150930 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-12be6e18-a2f9-4533-baae-3108bc290604 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:22.333419 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-12be6e18-a2f9-4533-baae-3108bc290604 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:22.341888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-12be6e18-a2f9-4533-baae-3108bc290604 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1313 microversion: 2.1 time: 0.204193 Aug 17 19:41:22.342904 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 159/330] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:22 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:22.478051 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a81960be-a95d-40a5-a09c-4f26b72d9b17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:22.478588 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a81960be-a95d-40a5-a09c-4f26b72d9b17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:22.486556 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a81960be-a95d-40a5-a09c-4f26b72d9b17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:22.487044 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a81960be-a95d-40a5-a09c-4f26b72d9b17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:22.487476 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a81960be-a95d-40a5-a09c-4f26b72d9b17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:22.488169 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a81960be-a95d-40a5-a09c-4f26b72d9b17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:22.488624 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a81960be-a95d-40a5-a09c-4f26b72d9b17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:22.489048 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a81960be-a95d-40a5-a09c-4f26b72d9b17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:22.500491 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-76883941-ef50-415f-8531-19125d3941b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:22.501096 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-76883941-ef50-415f-8531-19125d3941b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:22.507190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76883941-ef50-415f-8531-19125d3941b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:22.508025 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76883941-ef50-415f-8531-19125d3941b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:22.508451 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76883941-ef50-415f-8531-19125d3941b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:22.509249 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76883941-ef50-415f-8531-19125d3941b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:22.509692 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76883941-ef50-415f-8531-19125d3941b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:22.510291 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76883941-ef50-415f-8531-19125d3941b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:22.553000 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a81960be-a95d-40a5-a09c-4f26b72d9b17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:22.561017 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a81960be-a95d-40a5-a09c-4f26b72d9b17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1250 microversion: 2.1 time: 0.087283 Aug 17 19:41:22.562165 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 172/331] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:22 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:22.668709 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-76883941-ef50-415f-8531-19125d3941b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:22.698018 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-76883941-ef50-415f-8531-19125d3941b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:22.700574 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-76883941-ef50-415f-8531-19125d3941b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:22.701759 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-76883941-ef50-415f-8531-19125d3941b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1738 microversion: 2.20 time: 0.206892 Aug 17 19:41:22.710036 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 160/332] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:22 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:23.074688 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-dcdd2b6f-3287-46b9-8a17-b26bb49258ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:23.075943 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-dcdd2b6f-3287-46b9-8a17-b26bb49258ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:23.082328 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dcdd2b6f-3287-46b9-8a17-b26bb49258ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.082807 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dcdd2b6f-3287-46b9-8a17-b26bb49258ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.083428 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dcdd2b6f-3287-46b9-8a17-b26bb49258ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.084121 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dcdd2b6f-3287-46b9-8a17-b26bb49258ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.084571 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dcdd2b6f-3287-46b9-8a17-b26bb49258ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.084989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dcdd2b6f-3287-46b9-8a17-b26bb49258ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.104274 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-582b525d-a881-4863-b0ab-4e7db816c647 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:23.104881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-582b525d-a881-4863-b0ab-4e7db816c647 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:23.114831 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-582b525d-a881-4863-b0ab-4e7db816c647 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.116351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-582b525d-a881-4863-b0ab-4e7db816c647 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.117162 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-582b525d-a881-4863-b0ab-4e7db816c647 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.118513 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-582b525d-a881-4863-b0ab-4e7db816c647 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.118972 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-582b525d-a881-4863-b0ab-4e7db816c647 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.119394 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-582b525d-a881-4863-b0ab-4e7db816c647 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.373444 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-dcdd2b6f-3287-46b9-8a17-b26bb49258ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:23.382957 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-dcdd2b6f-3287-46b9-8a17-b26bb49258ff tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1315 microversion: 2.1 time: 0.313700 Aug 17 19:41:23.389855 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 173/333] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:23 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:23.395668 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-07f099b4-1035-4e1d-98a9-2f8f29dfcee4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:23.397962 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-07f099b4-1035-4e1d-98a9-2f8f29dfcee4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:23.408153 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-07f099b4-1035-4e1d-98a9-2f8f29dfcee4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.408534 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-07f099b4-1035-4e1d-98a9-2f8f29dfcee4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.408960 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-07f099b4-1035-4e1d-98a9-2f8f29dfcee4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.413042 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-07f099b4-1035-4e1d-98a9-2f8f29dfcee4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.414043 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-07f099b4-1035-4e1d-98a9-2f8f29dfcee4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.414716 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-07f099b4-1035-4e1d-98a9-2f8f29dfcee4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.427967 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-582b525d-a881-4863-b0ab-4e7db816c647 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:23.437129 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-582b525d-a881-4863-b0ab-4e7db816c647 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1548 microversion: 2.1 time: 0.336990 Aug 17 19:41:23.438370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 161/334] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:23 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1548 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:23.461825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6bff5991-1c81-4867-b0cd-9efd562af668 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:23.463565 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-6bff5991-1c81-4867-b0cd-9efd562af668 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:23.477035 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6bff5991-1c81-4867-b0cd-9efd562af668 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.477963 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6bff5991-1c81-4867-b0cd-9efd562af668 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.478704 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6bff5991-1c81-4867-b0cd-9efd562af668 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.479639 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6bff5991-1c81-4867-b0cd-9efd562af668 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.480982 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6bff5991-1c81-4867-b0cd-9efd562af668 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.481950 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6bff5991-1c81-4867-b0cd-9efd562af668 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.644670 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-07f099b4-1035-4e1d-98a9-2f8f29dfcee4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:23.657887 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-07f099b4-1035-4e1d-98a9-2f8f29dfcee4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1313 microversion: 2.1 time: 0.266386 Aug 17 19:41:23.671191 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 174/335] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:23 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:23.676247 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-455600e4-2aac-4c05-9f90-5899b4a58f7e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:23.677123 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-455600e4-2aac-4c05-9f90-5899b4a58f7e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:23.686960 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-455600e4-2aac-4c05-9f90-5899b4a58f7e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.687499 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-455600e4-2aac-4c05-9f90-5899b4a58f7e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.688229 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-455600e4-2aac-4c05-9f90-5899b4a58f7e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.689028 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-455600e4-2aac-4c05-9f90-5899b4a58f7e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.689579 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-455600e4-2aac-4c05-9f90-5899b4a58f7e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.690231 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-455600e4-2aac-4c05-9f90-5899b4a58f7e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.706777 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6bff5991-1c81-4867-b0cd-9efd562af668 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:23.731939 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-6bff5991-1c81-4867-b0cd-9efd562af668 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1548 microversion: 2.1 time: 0.274450 Aug 17 19:41:23.734236 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 162/336] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:23 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1548 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:23.742295 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-33933d51-5aec-4ce3-899c-10478a025370 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:23.742944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-33933d51-5aec-4ce3-899c-10478a025370 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:23.750148 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-33933d51-5aec-4ce3-899c-10478a025370 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.750932 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-33933d51-5aec-4ce3-899c-10478a025370 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.751671 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-33933d51-5aec-4ce3-899c-10478a025370 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.752546 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-33933d51-5aec-4ce3-899c-10478a025370 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.753103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-33933d51-5aec-4ce3-899c-10478a025370 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.753772 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-33933d51-5aec-4ce3-899c-10478a025370 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.788480 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-455600e4-2aac-4c05-9f90-5899b4a58f7e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:23.796083 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-455600e4-2aac-4c05-9f90-5899b4a58f7e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1298 microversion: 2.1 time: 0.123477 Aug 17 19:41:23.796657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 175/337] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:23 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:23.803719 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-bf3f6bd5-028b-46b8-909c-437344a24e51 req-9f0775d1-71d9-4850-81be-39a56a36de42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b9d664-2c4c-453b-8859-b36d62f08a3a", "name": "network-vif-plugged", "status": "completed", "tag": "5489f946-7da1-4771-9ff2-0ec4a18c823f"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:23.813874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-bf3f6bd5-028b-46b8-909c-437344a24e51 req-9f0775d1-71d9-4850-81be-39a56a36de42 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.814686 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-bf3f6bd5-028b-46b8-909c-437344a24e51 req-9f0775d1-71d9-4850-81be-39a56a36de42 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.815317 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-bf3f6bd5-028b-46b8-909c-437344a24e51 req-9f0775d1-71d9-4850-81be-39a56a36de42 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.828380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-bf3f6bd5-028b-46b8-909c-437344a24e51 req-9f0775d1-71d9-4850-81be-39a56a36de42 service nova] Creating event network-vif-plugged:5489f946-7da1-4771-9ff2-0ec4a18c823f for instance c6b9d664-2c4c-453b-8859-b36d62f08a3a on hv-cinder-85069 Aug 17 19:41:23.834816 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-bf3f6bd5-028b-46b8-909c-437344a24e51 req-9f0775d1-71d9-4850-81be-39a56a36de42 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036590 Aug 17 19:41:23.836568 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 176/338] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:23.843432 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-90f6cdda-f301-4584-bb6a-e37bfaab7705 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:23.848367 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-90f6cdda-f301-4584-bb6a-e37bfaab7705 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:23.849345 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-90f6cdda-f301-4584-bb6a-e37bfaab7705 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Searching by: {'deleted': False, 'project_id': 'cd2089b2265341b291a0db883f0d211f'} {{(pid=132531) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 17 19:41:23.856203 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-90f6cdda-f301-4584-bb6a-e37bfaab7705 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.856686 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-90f6cdda-f301-4584-bb6a-e37bfaab7705 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.857119 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-90f6cdda-f301-4584-bb6a-e37bfaab7705 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.857887 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-90f6cdda-f301-4584-bb6a-e37bfaab7705 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:23.858343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-90f6cdda-f301-4584-bb6a-e37bfaab7705 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:23.858766 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-90f6cdda-f301-4584-bb6a-e37bfaab7705 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:23.975291 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-33933d51-5aec-4ce3-899c-10478a025370 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:23.981045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.multi_cell_list [None req-90f6cdda-f301-4584-bb6a-e37bfaab7705 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132531) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 17 19:41:23.984888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-33933d51-5aec-4ce3-899c-10478a025370 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:23.986576 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-33933d51-5aec-4ce3-899c-10478a025370 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:23.987873 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-33933d51-5aec-4ce3-899c-10478a025370 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1738 microversion: 2.20 time: 0.249815 Aug 17 19:41:23.988418 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 163/339] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:23 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:24.094787 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-90f6cdda-f301-4584-bb6a-e37bfaab7705 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.256648 Aug 17 19:41:24.095278 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 177/340] 10.222.0.59 () {58 vars in 1125 bytes} [Wed Aug 17 19:41:23 2022] GET /compute/v2.1/servers => generated 342 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:24.110913 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5af8baa9-f313-4f56-8435-83035597b8c7 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:24.112735 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5af8baa9-f313-4f56-8435-83035597b8c7 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:24.114929 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:24.130186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5af8baa9-f313-4f56-8435-83035597b8c7 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:24.131087 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5af8baa9-f313-4f56-8435-83035597b8c7 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:24.131700 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5af8baa9-f313-4f56-8435-83035597b8c7 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:24.132621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5af8baa9-f313-4f56-8435-83035597b8c7 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:24.133247 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5af8baa9-f313-4f56-8435-83035597b8c7 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:24.133813 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5af8baa9-f313-4f56-8435-83035597b8c7 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:24.338324 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5af8baa9-f313-4f56-8435-83035597b8c7 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:24.347345 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5af8baa9-f313-4f56-8435-83035597b8c7 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1548 microversion: 2.1 time: 0.240692 Aug 17 19:41:24.348226 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 164/341] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:24 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1548 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:24.406350 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-be22f133-9760-44f0-80fd-7c90a81efdfc tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:24.407130 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-be22f133-9760-44f0-80fd-7c90a81efdfc tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:24.417419 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be22f133-9760-44f0-80fd-7c90a81efdfc tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:24.418444 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be22f133-9760-44f0-80fd-7c90a81efdfc tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:24.426319 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be22f133-9760-44f0-80fd-7c90a81efdfc tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:24.428159 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be22f133-9760-44f0-80fd-7c90a81efdfc tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:24.441262 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be22f133-9760-44f0-80fd-7c90a81efdfc tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:24.441868 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be22f133-9760-44f0-80fd-7c90a81efdfc tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:24.622177 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-be22f133-9760-44f0-80fd-7c90a81efdfc tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:24.633877 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-be22f133-9760-44f0-80fd-7c90a81efdfc tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1315 microversion: 2.1 time: 0.231966 Aug 17 19:41:24.647734 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 178/342] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:24 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:24.678696 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c817dd0d-3b1d-420a-b372-36689a31115d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:24.679303 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c817dd0d-3b1d-420a-b372-36689a31115d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:24.688867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c817dd0d-3b1d-420a-b372-36689a31115d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:24.689503 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c817dd0d-3b1d-420a-b372-36689a31115d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:24.689841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c817dd0d-3b1d-420a-b372-36689a31115d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:24.690541 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c817dd0d-3b1d-420a-b372-36689a31115d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:24.691043 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c817dd0d-3b1d-420a-b372-36689a31115d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:24.691459 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c817dd0d-3b1d-420a-b372-36689a31115d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:24.816355 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a13afa92-a3d4-4152-80ff-7736f6ac7fb8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:24.816964 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a13afa92-a3d4-4152-80ff-7736f6ac7fb8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:24.824900 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a13afa92-a3d4-4152-80ff-7736f6ac7fb8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:24.828320 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a13afa92-a3d4-4152-80ff-7736f6ac7fb8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:24.829755 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a13afa92-a3d4-4152-80ff-7736f6ac7fb8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:24.835686 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a13afa92-a3d4-4152-80ff-7736f6ac7fb8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:24.836393 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a13afa92-a3d4-4152-80ff-7736f6ac7fb8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:24.836996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a13afa92-a3d4-4152-80ff-7736f6ac7fb8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:24.961661 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a13afa92-a3d4-4152-80ff-7736f6ac7fb8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:24.974625 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a13afa92-a3d4-4152-80ff-7736f6ac7fb8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1304 microversion: 2.1 time: 0.159441 Aug 17 19:41:24.975243 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 179/343] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:24 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1304 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:24.988567 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c817dd0d-3b1d-420a-b372-36689a31115d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:24.989497 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c817dd0d-3b1d-420a-b372-36689a31115d tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1313 microversion: 2.1 time: 0.314895 Aug 17 19:41:24.990338 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 165/344] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:24 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:25.014915 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b7a2f4cd-b2fd-403a-960c-35987e900794 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:25.016250 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b7a2f4cd-b2fd-403a-960c-35987e900794 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:25.026233 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b7a2f4cd-b2fd-403a-960c-35987e900794 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:25.026727 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b7a2f4cd-b2fd-403a-960c-35987e900794 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:25.027881 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b7a2f4cd-b2fd-403a-960c-35987e900794 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:25.028606 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b7a2f4cd-b2fd-403a-960c-35987e900794 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:25.029055 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b7a2f4cd-b2fd-403a-960c-35987e900794 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:25.029501 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b7a2f4cd-b2fd-403a-960c-35987e900794 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:25.260478 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b7a2f4cd-b2fd-403a-960c-35987e900794 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:25.268929 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b7a2f4cd-b2fd-403a-960c-35987e900794 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:25.270444 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b7a2f4cd-b2fd-403a-960c-35987e900794 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:25.271570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b7a2f4cd-b2fd-403a-960c-35987e900794 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1738 microversion: 2.20 time: 0.262506 Aug 17 19:41:25.285600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 180/345] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:25 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:25.657655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-379e323c-065e-4a07-90d8-b6a9c51d722b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:25.658338 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-379e323c-065e-4a07-90d8-b6a9c51d722b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:25.681325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-379e323c-065e-4a07-90d8-b6a9c51d722b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:25.684310 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-379e323c-065e-4a07-90d8-b6a9c51d722b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:25.684878 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-379e323c-065e-4a07-90d8-b6a9c51d722b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:25.685749 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-379e323c-065e-4a07-90d8-b6a9c51d722b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:25.688514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-379e323c-065e-4a07-90d8-b6a9c51d722b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:25.689072 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-379e323c-065e-4a07-90d8-b6a9c51d722b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:25.878642 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-379e323c-065e-4a07-90d8-b6a9c51d722b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:25.886965 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-379e323c-065e-4a07-90d8-b6a9c51d722b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1315 microversion: 2.1 time: 0.234331 Aug 17 19:41:25.887534 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 166/346] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:25 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:25.996024 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e1339d02-63d6-44ae-bee5-a6985a420edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:25.997891 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e1339d02-63d6-44ae-bee5-a6985a420edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:26.011912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-179aff48-4097-4ce7-8ec4-83396d3530a8 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:26.012673 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-179aff48-4097-4ce7-8ec4-83396d3530a8 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:26.016573 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e1339d02-63d6-44ae-bee5-a6985a420edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:26.018937 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e1339d02-63d6-44ae-bee5-a6985a420edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:26.020746 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-179aff48-4097-4ce7-8ec4-83396d3530a8 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:26.021436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e1339d02-63d6-44ae-bee5-a6985a420edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:26.022418 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e1339d02-63d6-44ae-bee5-a6985a420edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:26.022987 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e1339d02-63d6-44ae-bee5-a6985a420edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:26.023625 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-179aff48-4097-4ce7-8ec4-83396d3530a8 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:26.024188 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e1339d02-63d6-44ae-bee5-a6985a420edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:26.024718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-179aff48-4097-4ce7-8ec4-83396d3530a8 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:26.028250 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-179aff48-4097-4ce7-8ec4-83396d3530a8 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:26.028834 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-179aff48-4097-4ce7-8ec4-83396d3530a8 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:26.029409 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-179aff48-4097-4ce7-8ec4-83396d3530a8 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:26.032347 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=100 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:26.329509 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e1339d02-63d6-44ae-bee5-a6985a420edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:26.341943 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e1339d02-63d6-44ae-bee5-a6985a420edc tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.349519 Aug 17 19:41:26.343130 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 181/347] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:25 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:26.352996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e0e2712c-0885-462c-aa96-12c7f4d42448 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:26.353993 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e0e2712c-0885-462c-aa96-12c7f4d42448 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:26.363045 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-179aff48-4097-4ce7-8ec4-83396d3530a8 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:26.371240 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-179aff48-4097-4ce7-8ec4-83396d3530a8 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1496 microversion: 2.1 time: 0.363165 Aug 17 19:41:26.374382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 167/348] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:26 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1496 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:26.377346 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e0e2712c-0885-462c-aa96-12c7f4d42448 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:26.378011 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e0e2712c-0885-462c-aa96-12c7f4d42448 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:26.378641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e0e2712c-0885-462c-aa96-12c7f4d42448 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:26.380118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e0e2712c-0885-462c-aa96-12c7f4d42448 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:26.380717 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e0e2712c-0885-462c-aa96-12c7f4d42448 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:26.381372 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e0e2712c-0885-462c-aa96-12c7f4d42448 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:26.470465 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-893e0096-6966-44a9-bebc-c1e969268b3f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d47197a4-f746-4d62-81c7-736df09bdc22"}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:26.473188 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-893e0096-6966-44a9-bebc-c1e969268b3f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:26.481971 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-893e0096-6966-44a9-bebc-c1e969268b3f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:26.482790 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-893e0096-6966-44a9-bebc-c1e969268b3f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:26.484534 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-893e0096-6966-44a9-bebc-c1e969268b3f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:26.486527 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-893e0096-6966-44a9-bebc-c1e969268b3f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:26.487215 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-893e0096-6966-44a9-bebc-c1e969268b3f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:26.488156 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-893e0096-6966-44a9-bebc-c1e969268b3f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:26.609374 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e0e2712c-0885-462c-aa96-12c7f4d42448 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:26.619781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e0e2712c-0885-462c-aa96-12c7f4d42448 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:26.624739 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e0e2712c-0885-462c-aa96-12c7f4d42448 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:26.627230 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e0e2712c-0885-462c-aa96-12c7f4d42448 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1738 microversion: 2.20 time: 0.282882 Aug 17 19:41:26.627917 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 182/349] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:26 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:26.853789 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-893e0096-6966-44a9-bebc-c1e969268b3f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "POST /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389042 Aug 17 19:41:26.856336 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 168/350] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:41:26 2022] POST /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:41:26.908003 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-badd1d6a-3d90-40c9-8559-ad4b2ce23d0e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:26.908618 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-badd1d6a-3d90-40c9-8559-ad4b2ce23d0e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:26.933928 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-badd1d6a-3d90-40c9-8559-ad4b2ce23d0e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:26.934436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-badd1d6a-3d90-40c9-8559-ad4b2ce23d0e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:26.934879 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-badd1d6a-3d90-40c9-8559-ad4b2ce23d0e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:26.935597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-badd1d6a-3d90-40c9-8559-ad4b2ce23d0e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:26.936060 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-badd1d6a-3d90-40c9-8559-ad4b2ce23d0e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:26.936485 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-badd1d6a-3d90-40c9-8559-ad4b2ce23d0e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:27.035375 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-72eb6ff4-c5cf-4cca-92e6-5dd064b7bf36 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:27.035971 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-72eb6ff4-c5cf-4cca-92e6-5dd064b7bf36 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:27.046520 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-72eb6ff4-c5cf-4cca-92e6-5dd064b7bf36 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:27.047031 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-72eb6ff4-c5cf-4cca-92e6-5dd064b7bf36 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:27.047454 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-72eb6ff4-c5cf-4cca-92e6-5dd064b7bf36 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:27.052006 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-72eb6ff4-c5cf-4cca-92e6-5dd064b7bf36 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:27.055133 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-72eb6ff4-c5cf-4cca-92e6-5dd064b7bf36 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:27.055791 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-72eb6ff4-c5cf-4cca-92e6-5dd064b7bf36 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:27.104901 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-72eb6ff4-c5cf-4cca-92e6-5dd064b7bf36 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Going to try to terminate instance {{(pid=132530) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:41:27.204550 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-badd1d6a-3d90-40c9-8559-ad4b2ce23d0e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:27.212873 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=100 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:27.227938 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-badd1d6a-3d90-40c9-8559-ad4b2ce23d0e tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1315 microversion: 2.1 time: 0.321502 Aug 17 19:41:27.228535 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 183/351] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:26 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:27.238318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-e2780bd2-4359-4b14-8b1c-bef3755a8edb req-b9d27473-520f-48af-86ed-46212b25c910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb", "tag": "bf5dc59e-079d-4504-b553-f9c0418123e9"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:27.260919 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-e2780bd2-4359-4b14-8b1c-bef3755a8edb req-b9d27473-520f-48af-86ed-46212b25c910 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:27.263642 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-e2780bd2-4359-4b14-8b1c-bef3755a8edb req-b9d27473-520f-48af-86ed-46212b25c910 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:27.264483 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-e2780bd2-4359-4b14-8b1c-bef3755a8edb req-b9d27473-520f-48af-86ed-46212b25c910 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:27.276250 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-e2780bd2-4359-4b14-8b1c-bef3755a8edb req-b9d27473-520f-48af-86ed-46212b25c910 service nova] Creating event network-changed:bf5dc59e-079d-4504-b553-f9c0418123e9 for instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb on hv-cinder-85069 Aug 17 19:41:27.277346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-72eb6ff4-c5cf-4cca-92e6-5dd064b7bf36 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 204 len: 0 microversion: 2.1 time: 0.245329 Aug 17 19:41:27.282088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 169/352] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:41:27 2022] DELETE /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 19:41:27.285332 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-e2780bd2-4359-4b14-8b1c-bef3755a8edb req-b9d27473-520f-48af-86ed-46212b25c910 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053889 Aug 17 19:41:27.286179 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 184/353] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:27.291001 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e68d4898-e2fc-44eb-baf8-daa90f256223 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:27.291896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e68d4898-e2fc-44eb-baf8-daa90f256223 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:27.298796 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e68d4898-e2fc-44eb-baf8-daa90f256223 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:27.299556 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e68d4898-e2fc-44eb-baf8-daa90f256223 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:27.300198 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e68d4898-e2fc-44eb-baf8-daa90f256223 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:27.301109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e68d4898-e2fc-44eb-baf8-daa90f256223 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:27.301680 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e68d4898-e2fc-44eb-baf8-daa90f256223 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:27.302182 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e68d4898-e2fc-44eb-baf8-daa90f256223 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:27.383319 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-65067dfa-78f7-4fed-bf45-a10b76aaaa3b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:27.384311 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-65067dfa-78f7-4fed-bf45-a10b76aaaa3b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:27.400897 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65067dfa-78f7-4fed-bf45-a10b76aaaa3b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:27.401429 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65067dfa-78f7-4fed-bf45-a10b76aaaa3b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:27.403075 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65067dfa-78f7-4fed-bf45-a10b76aaaa3b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:27.403978 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65067dfa-78f7-4fed-bf45-a10b76aaaa3b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:27.408357 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65067dfa-78f7-4fed-bf45-a10b76aaaa3b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:27.409313 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65067dfa-78f7-4fed-bf45-a10b76aaaa3b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:27.464882 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e68d4898-e2fc-44eb-baf8-daa90f256223 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:27.477245 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e68d4898-e2fc-44eb-baf8-daa90f256223 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1502 microversion: 2.1 time: 0.192601 Aug 17 19:41:27.478397 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 170/354] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:27 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:27.630885 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-91d2bb6b-bfa8-4964-9a5f-d5af05b59cfc req-63a27015-bdec-4a5c-9963-33f917c0dd72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93ae0457-5029-49a2-9182-4124ba6b015f", "name": "network-vif-plugged", "status": "completed", "tag": "6c9849e7-051b-4d58-899b-fcadcef2f78d"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:27.650833 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-91d2bb6b-bfa8-4964-9a5f-d5af05b59cfc req-63a27015-bdec-4a5c-9963-33f917c0dd72 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:27.652441 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-91d2bb6b-bfa8-4964-9a5f-d5af05b59cfc req-63a27015-bdec-4a5c-9963-33f917c0dd72 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:27.653032 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-91d2bb6b-bfa8-4964-9a5f-d5af05b59cfc req-63a27015-bdec-4a5c-9963-33f917c0dd72 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:27.657771 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-65067dfa-78f7-4fed-bf45-a10b76aaaa3b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:27.669747 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-65067dfa-78f7-4fed-bf45-a10b76aaaa3b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.303774 Aug 17 19:41:27.671620 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 185/355] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:27 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:27.684755 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-487c0b7a-7f42-4af9-8308-0711cbbe213d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:27.685398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-487c0b7a-7f42-4af9-8308-0711cbbe213d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:27.694525 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-91d2bb6b-bfa8-4964-9a5f-d5af05b59cfc req-63a27015-bdec-4a5c-9963-33f917c0dd72 service nova] Creating event network-vif-plugged:6c9849e7-051b-4d58-899b-fcadcef2f78d for instance 93ae0457-5029-49a2-9182-4124ba6b015f on hv-cinder-85069 Aug 17 19:41:27.696731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-487c0b7a-7f42-4af9-8308-0711cbbe213d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:27.697437 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-487c0b7a-7f42-4af9-8308-0711cbbe213d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:27.698062 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-487c0b7a-7f42-4af9-8308-0711cbbe213d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:27.698966 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-487c0b7a-7f42-4af9-8308-0711cbbe213d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:27.700120 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-91d2bb6b-bfa8-4964-9a5f-d5af05b59cfc req-63a27015-bdec-4a5c-9963-33f917c0dd72 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073583 Aug 17 19:41:27.701018 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-487c0b7a-7f42-4af9-8308-0711cbbe213d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:27.701158 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 171/356] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:41:27.703894 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-487c0b7a-7f42-4af9-8308-0711cbbe213d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:27.859544 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-487c0b7a-7f42-4af9-8308-0711cbbe213d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:27.869246 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-487c0b7a-7f42-4af9-8308-0711cbbe213d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:27.870834 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-487c0b7a-7f42-4af9-8308-0711cbbe213d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:27.871995 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-487c0b7a-7f42-4af9-8308-0711cbbe213d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1738 microversion: 2.20 time: 0.198160 Aug 17 19:41:27.872555 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 186/357] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:27 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:28.250324 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a216fc0f-1c8e-4ad2-ae17-be487cf069fd tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:28.251102 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a216fc0f-1c8e-4ad2-ae17-be487cf069fd tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:28.259845 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a216fc0f-1c8e-4ad2-ae17-be487cf069fd tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:28.260816 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a216fc0f-1c8e-4ad2-ae17-be487cf069fd tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:28.261839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a216fc0f-1c8e-4ad2-ae17-be487cf069fd tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:28.262542 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a216fc0f-1c8e-4ad2-ae17-be487cf069fd tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:28.262991 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a216fc0f-1c8e-4ad2-ae17-be487cf069fd tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:28.263408 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a216fc0f-1c8e-4ad2-ae17-be487cf069fd tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:28.310298 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=6 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:28.406306 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a216fc0f-1c8e-4ad2-ae17-be487cf069fd tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:28.415077 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a216fc0f-1c8e-4ad2-ae17-be487cf069fd tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1315 microversion: 2.1 time: 0.169522 Aug 17 19:41:28.416119 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 172/358] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:28 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:28.501638 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d4b68f7c-1258-43a1-8e18-4916b946cdff tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:28.502164 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d4b68f7c-1258-43a1-8e18-4916b946cdff tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:28.511545 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4b68f7c-1258-43a1-8e18-4916b946cdff tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:28.512040 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4b68f7c-1258-43a1-8e18-4916b946cdff tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:28.512992 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4b68f7c-1258-43a1-8e18-4916b946cdff tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:28.513733 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4b68f7c-1258-43a1-8e18-4916b946cdff tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:28.514187 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4b68f7c-1258-43a1-8e18-4916b946cdff tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:28.514607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4b68f7c-1258-43a1-8e18-4916b946cdff tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:28.658273 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d4b68f7c-1258-43a1-8e18-4916b946cdff tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:28.666433 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d4b68f7c-1258-43a1-8e18-4916b946cdff tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1502 microversion: 2.1 time: 0.168593 Aug 17 19:41:28.667231 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 187/359] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:28 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:28.690361 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-77b35b4b-e989-4dfe-a63d-1be50ed12e9d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:28.690971 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-77b35b4b-e989-4dfe-a63d-1be50ed12e9d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:28.697406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77b35b4b-e989-4dfe-a63d-1be50ed12e9d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:28.697896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77b35b4b-e989-4dfe-a63d-1be50ed12e9d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:28.698326 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77b35b4b-e989-4dfe-a63d-1be50ed12e9d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:28.699653 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77b35b4b-e989-4dfe-a63d-1be50ed12e9d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:28.700100 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77b35b4b-e989-4dfe-a63d-1be50ed12e9d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:28.700778 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77b35b4b-e989-4dfe-a63d-1be50ed12e9d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:28.899297 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-42f1215c-b5a1-43e8-8584-bad0b281c2fb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:28.899907 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-42f1215c-b5a1-43e8-8584-bad0b281c2fb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:28.906574 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-42f1215c-b5a1-43e8-8584-bad0b281c2fb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:28.907065 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-42f1215c-b5a1-43e8-8584-bad0b281c2fb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:28.907493 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-42f1215c-b5a1-43e8-8584-bad0b281c2fb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:28.908193 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-42f1215c-b5a1-43e8-8584-bad0b281c2fb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:28.908629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-42f1215c-b5a1-43e8-8584-bad0b281c2fb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:28.909195 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-42f1215c-b5a1-43e8-8584-bad0b281c2fb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:28.953691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-77b35b4b-e989-4dfe-a63d-1be50ed12e9d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:28.967858 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-77b35b4b-e989-4dfe-a63d-1be50ed12e9d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.281304 Aug 17 19:41:28.981248 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 173/360] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:28 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:29.075790 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-42f1215c-b5a1-43e8-8584-bad0b281c2fb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:29.086071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-42f1215c-b5a1-43e8-8584-bad0b281c2fb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:29.087738 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-42f1215c-b5a1-43e8-8584-bad0b281c2fb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:29.088920 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-42f1215c-b5a1-43e8-8584-bad0b281c2fb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1738 microversion: 2.20 time: 0.195369 Aug 17 19:41:29.090578 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 188/361] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:28 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1738 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:29.438513 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-7d8d9aa4-80df-43c1-b22a-b593314320a8 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:29.439131 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-7d8d9aa4-80df-43c1-b22a-b593314320a8 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:29.446364 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7d8d9aa4-80df-43c1-b22a-b593314320a8 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:29.447157 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7d8d9aa4-80df-43c1-b22a-b593314320a8 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:29.447817 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7d8d9aa4-80df-43c1-b22a-b593314320a8 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:29.448785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7d8d9aa4-80df-43c1-b22a-b593314320a8 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:29.449493 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7d8d9aa4-80df-43c1-b22a-b593314320a8 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:29.450117 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7d8d9aa4-80df-43c1-b22a-b593314320a8 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:29.622568 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-7d8d9aa4-80df-43c1-b22a-b593314320a8 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:29.632050 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-7d8d9aa4-80df-43c1-b22a-b593314320a8 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1315 microversion: 2.1 time: 0.199672 Aug 17 19:41:29.632862 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 174/362] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:29 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:29.690373 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e982ddc3-1dff-4689-b007-93833c42311a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:29.691718 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e982ddc3-1dff-4689-b007-93833c42311a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:29.701347 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e982ddc3-1dff-4689-b007-93833c42311a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:29.701847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e982ddc3-1dff-4689-b007-93833c42311a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:29.702288 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e982ddc3-1dff-4689-b007-93833c42311a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:29.702995 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e982ddc3-1dff-4689-b007-93833c42311a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:29.703452 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e982ddc3-1dff-4689-b007-93833c42311a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:29.703882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e982ddc3-1dff-4689-b007-93833c42311a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:29.782190 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e982ddc3-1dff-4689-b007-93833c42311a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:29.794137 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e982ddc3-1dff-4689-b007-93833c42311a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1460 microversion: 2.1 time: 0.109922 Aug 17 19:41:29.807353 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 189/363] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:29 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1460 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:29.807563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-65baa8bb-2166-46ab-aed7-2fc1b2616aca req-f8d44fcd-e07e-445a-a437-972fe5ae55d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6b9d664-2c4c-453b-8859-b36d62f08a3a", "name": "network-vif-deleted", "tag": "5489f946-7da1-4771-9ff2-0ec4a18c823f"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:29.815483 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-65baa8bb-2166-46ab-aed7-2fc1b2616aca req-f8d44fcd-e07e-445a-a437-972fe5ae55d3 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:29.816078 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-65baa8bb-2166-46ab-aed7-2fc1b2616aca req-f8d44fcd-e07e-445a-a437-972fe5ae55d3 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:29.816654 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-65baa8bb-2166-46ab-aed7-2fc1b2616aca req-f8d44fcd-e07e-445a-a437-972fe5ae55d3 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:29.829116 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-65baa8bb-2166-46ab-aed7-2fc1b2616aca req-f8d44fcd-e07e-445a-a437-972fe5ae55d3 service nova] Creating event network-vif-deleted:5489f946-7da1-4771-9ff2-0ec4a18c823f for instance c6b9d664-2c4c-453b-8859-b36d62f08a3a on hv-cinder-85069 Aug 17 19:41:29.834579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-65baa8bb-2166-46ab-aed7-2fc1b2616aca req-f8d44fcd-e07e-445a-a437-972fe5ae55d3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036459 Aug 17 19:41:29.835565 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 175/364] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:29.992792 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d75fe507-71c8-470d-bbf4-e1b9e074194f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:29.993438 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d75fe507-71c8-470d-bbf4-e1b9e074194f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:30.000306 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d75fe507-71c8-470d-bbf4-e1b9e074194f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:30.000794 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d75fe507-71c8-470d-bbf4-e1b9e074194f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:30.001258 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d75fe507-71c8-470d-bbf4-e1b9e074194f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:30.002475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d75fe507-71c8-470d-bbf4-e1b9e074194f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:30.002617 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d75fe507-71c8-470d-bbf4-e1b9e074194f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:30.002985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d75fe507-71c8-470d-bbf4-e1b9e074194f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:30.113883 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-abae0aa5-1689-4c58-9729-9d038ffd3233 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:30.114700 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-abae0aa5-1689-4c58-9729-9d038ffd3233 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:30.122041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-abae0aa5-1689-4c58-9729-9d038ffd3233 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:30.122622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-abae0aa5-1689-4c58-9729-9d038ffd3233 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:30.123149 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-abae0aa5-1689-4c58-9729-9d038ffd3233 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:30.123905 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-abae0aa5-1689-4c58-9729-9d038ffd3233 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:30.124427 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-abae0aa5-1689-4c58-9729-9d038ffd3233 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:30.125066 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-abae0aa5-1689-4c58-9729-9d038ffd3233 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:30.165808 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d75fe507-71c8-470d-bbf4-e1b9e074194f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:30.174315 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d75fe507-71c8-470d-bbf4-e1b9e074194f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.186085 Aug 17 19:41:30.193476 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 190/365] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:29 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:30.298730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-abae0aa5-1689-4c58-9729-9d038ffd3233 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:30.306700 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-abae0aa5-1689-4c58-9729-9d038ffd3233 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:30.308336 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-abae0aa5-1689-4c58-9729-9d038ffd3233 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:30.310171 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-abae0aa5-1689-4c58-9729-9d038ffd3233 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1738 microversion: 2.20 time: 0.199791 Aug 17 19:41:30.320848 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 176/366] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:30 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:41:30.654192 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c033ebc0-2d49-461d-9d91-3dae225aac51 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:30.654829 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-c033ebc0-2d49-461d-9d91-3dae225aac51 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:30.662269 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c033ebc0-2d49-461d-9d91-3dae225aac51 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:30.662759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c033ebc0-2d49-461d-9d91-3dae225aac51 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:30.663200 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c033ebc0-2d49-461d-9d91-3dae225aac51 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:30.663901 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c033ebc0-2d49-461d-9d91-3dae225aac51 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:30.664352 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c033ebc0-2d49-461d-9d91-3dae225aac51 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:30.664856 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c033ebc0-2d49-461d-9d91-3dae225aac51 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:30.812805 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-c033ebc0-2d49-461d-9d91-3dae225aac51 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:30.822623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-c033ebc0-2d49-461d-9d91-3dae225aac51 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1315 microversion: 2.1 time: 0.172738 Aug 17 19:41:30.823201 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 191/367] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:30 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:30.827089 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-89a57060-4e34-4c4c-a16c-4c7ea5a6460a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:30.828263 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-89a57060-4e34-4c4c-a16c-4c7ea5a6460a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:30.847737 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-89a57060-4e34-4c4c-a16c-4c7ea5a6460a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:30.848390 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-89a57060-4e34-4c4c-a16c-4c7ea5a6460a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:30.848920 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-89a57060-4e34-4c4c-a16c-4c7ea5a6460a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:30.849837 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-89a57060-4e34-4c4c-a16c-4c7ea5a6460a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:30.850369 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-89a57060-4e34-4c4c-a16c-4c7ea5a6460a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:30.850967 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-89a57060-4e34-4c4c-a16c-4c7ea5a6460a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:30.925183 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-89a57060-4e34-4c4c-a16c-4c7ea5a6460a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:30.935921 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-89a57060-4e34-4c4c-a16c-4c7ea5a6460a tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1298 microversion: 2.1 time: 0.121172 Aug 17 19:41:30.936512 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 177/368] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:30 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:31.195978 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b22ecb25-777d-414b-b95a-b46584ad5c4e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:31.196948 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b22ecb25-777d-414b-b95a-b46584ad5c4e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:31.203913 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b22ecb25-777d-414b-b95a-b46584ad5c4e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:31.204793 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b22ecb25-777d-414b-b95a-b46584ad5c4e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:31.205487 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b22ecb25-777d-414b-b95a-b46584ad5c4e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:31.206244 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b22ecb25-777d-414b-b95a-b46584ad5c4e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:31.206780 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b22ecb25-777d-414b-b95a-b46584ad5c4e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:31.207265 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b22ecb25-777d-414b-b95a-b46584ad5c4e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:31.335157 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6adcb59a-9783-41eb-a54c-b35557fe67ad tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:31.336147 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-6adcb59a-9783-41eb-a54c-b35557fe67ad tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:31.347494 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6adcb59a-9783-41eb-a54c-b35557fe67ad tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:31.348392 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6adcb59a-9783-41eb-a54c-b35557fe67ad tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:31.349301 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6adcb59a-9783-41eb-a54c-b35557fe67ad tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:31.350378 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6adcb59a-9783-41eb-a54c-b35557fe67ad tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:31.351467 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6adcb59a-9783-41eb-a54c-b35557fe67ad tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:31.352295 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6adcb59a-9783-41eb-a54c-b35557fe67ad tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:31.374486 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b22ecb25-777d-414b-b95a-b46584ad5c4e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:31.383201 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b22ecb25-777d-414b-b95a-b46584ad5c4e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.191104 Aug 17 19:41:31.383790 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 192/369] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:31 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:31.576069 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6adcb59a-9783-41eb-a54c-b35557fe67ad tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:31.586314 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6adcb59a-9783-41eb-a54c-b35557fe67ad tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:31.587969 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6adcb59a-9783-41eb-a54c-b35557fe67ad tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:31.589820 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-6adcb59a-9783-41eb-a54c-b35557fe67ad tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1738 microversion: 2.20 time: 0.258380 Aug 17 19:41:31.590702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 178/370] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:31 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:31.844683 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a58699fa-6c45-4968-a63e-2516580a3f5f tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:31.845568 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a58699fa-6c45-4968-a63e-2516580a3f5f tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:31.847517 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=14 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:31.854250 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a58699fa-6c45-4968-a63e-2516580a3f5f tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:31.854935 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a58699fa-6c45-4968-a63e-2516580a3f5f tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:31.855612 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a58699fa-6c45-4968-a63e-2516580a3f5f tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:31.856321 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a58699fa-6c45-4968-a63e-2516580a3f5f tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:31.856778 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a58699fa-6c45-4968-a63e-2516580a3f5f tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:31.857204 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a58699fa-6c45-4968-a63e-2516580a3f5f tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:31.958907 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:31.963679 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:31.974311 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:31.975170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:31.975763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:31.976631 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:31.977331 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:31.977900 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:32.018506 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:32.019019 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:32.019461 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:32.019928 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lazy-loading 'fault' on Instance uuid c6b9d664-2c4c-453b-8859-b36d62f08a3a {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:41:32.171535 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc2d61aa2c004363ba15753674123b15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12bd76b56a1d4dbcbf306843e0ade6bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:32.189424 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2b75cabb-c455-417c-9067-9452f8b181a4 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 200 len: 1303 microversion: 2.1 time: 0.229241 Aug 17 19:41:32.189710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 179/371] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:31 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 1303 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:32.251771 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a58699fa-6c45-4968-a63e-2516580a3f5f tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:32.259376 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a58699fa-6c45-4968-a63e-2516580a3f5f tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1315 microversion: 2.1 time: 0.418753 Aug 17 19:41:32.273395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 193/372] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:31 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:32.407978 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-af02822d-08be-4a1f-95e5-57713d9d5bcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:32.408598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-af02822d-08be-4a1f-95e5-57713d9d5bcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:32.414860 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-af02822d-08be-4a1f-95e5-57713d9d5bcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:32.415597 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-af02822d-08be-4a1f-95e5-57713d9d5bcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:32.416045 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-af02822d-08be-4a1f-95e5-57713d9d5bcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:32.416735 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-af02822d-08be-4a1f-95e5-57713d9d5bcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:32.417236 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-af02822d-08be-4a1f-95e5-57713d9d5bcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:32.417669 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-af02822d-08be-4a1f-95e5-57713d9d5bcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:32.552152 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-af02822d-08be-4a1f-95e5-57713d9d5bcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:32.562602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-af02822d-08be-4a1f-95e5-57713d9d5bcd tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.158442 Aug 17 19:41:32.563184 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 180/373] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:32 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:32.613239 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c18b7dc5-3c09-430b-9bed-c88a2ce65d29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:32.613855 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-c18b7dc5-3c09-430b-9bed-c88a2ce65d29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:32.619779 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c18b7dc5-3c09-430b-9bed-c88a2ce65d29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:32.620258 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c18b7dc5-3c09-430b-9bed-c88a2ce65d29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:32.621301 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c18b7dc5-3c09-430b-9bed-c88a2ce65d29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:32.621991 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c18b7dc5-3c09-430b-9bed-c88a2ce65d29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:32.622442 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c18b7dc5-3c09-430b-9bed-c88a2ce65d29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:32.622860 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c18b7dc5-3c09-430b-9bed-c88a2ce65d29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:32.768480 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-c18b7dc5-3c09-430b-9bed-c88a2ce65d29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:32.778816 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-c18b7dc5-3c09-430b-9bed-c88a2ce65d29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:32.780519 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-c18b7dc5-3c09-430b-9bed-c88a2ce65d29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:32.781731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-c18b7dc5-3c09-430b-9bed-c88a2ce65d29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1738 microversion: 2.20 time: 0.172432 Aug 17 19:41:32.782276 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 194/374] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:32 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:33.212041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c3141406-8758-4270-9570-0951b17c6366 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:33.212588 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c3141406-8758-4270-9570-0951b17c6366 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] [instance: c6b9d664-2c4c-453b-8859-b36d62f08a3a] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:33.219675 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c3141406-8758-4270-9570-0951b17c6366 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:33.220165 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c3141406-8758-4270-9570-0951b17c6366 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:33.220597 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c3141406-8758-4270-9570-0951b17c6366 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:33.221323 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c3141406-8758-4270-9570-0951b17c6366 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:33.221782 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c3141406-8758-4270-9570-0951b17c6366 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:33.222204 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c3141406-8758-4270-9570-0951b17c6366 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:33.237350 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-c3141406-8758-4270-9570-0951b17c6366 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] HTTP exception thrown: Instance c6b9d664-2c4c-453b-8859-b36d62f08a3a could not be found. Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c3141406-8758-4270-9570-0951b17c6366 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Request method failure captured: Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a HTTP/1.1 Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UQwYNRHCpvqHwzl3Rm912xB36VCBS6KfIUNjVqtls3OEuiSBCUOm8xnQNKDQBKZMyr7NnbgXQyLi33wyf_wYueQzqCB8lHrtOIC-Cmd6a-GCk871oRDCzpOsXDVWxJyhILvG6wegSA9uANkXaNPoj6OLfIWkv4rnpmNFTi0ZhXZ2GA Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: 12bd76b56a1d4dbcbf306843e0ade6bf Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-VolumesActionsTest-1926207285 Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:41:33.239257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:41:33.240795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/12bd76b56a1d4dbcbf306843e0ade6bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/12bd76b56a1d4dbcbf306843e0ade6bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_12bd76b56a1d4dbcbf306843e0ade6bf", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/12bd76b56a1d4dbcbf306843e0ade6bf"}]}] Aug 17 19:41:33.240795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-VolumesActionsTest-1926207285 Aug 17 19:41:33.240795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: 12bd76b56a1d4dbcbf306843e0ade6bf Aug 17 19:41:33.240795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-VolumesActionsTest-1926207285 Aug 17 19:41:33.240795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-VolumesActionsTest-1926207285-project Aug 17 19:41:33.240795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:41:33.240795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:41:33.240795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: cc2d61aa2c004363ba15753674123b15 Aug 17 19:41:33.240795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-VolumesActionsTest-1926207285-project Aug 17 19:41:33.240795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:41:33.240795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance c6b9d664-2c4c-453b-8859-b36d62f08a3a could not be found. Aug 17 19:41:33.240795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': 'c6b9d664-2c4c-453b-8859-b36d62f08a3a'} Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6b9d664-2c4c-453b-8859-b36d62f08a3a could not be found. Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:41:33.241775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6b9d664-2c4c-453b-8859-b36d62f08a3a could not be found. Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6b9d664-2c4c-453b-8859-b36d62f08a3a could not be found. Aug 17 19:41:33.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:33.244321 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c3141406-8758-4270-9570-0951b17c6366 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] Returning 404 to user: Instance c6b9d664-2c4c-453b-8859-b36d62f08a3a could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:41:33.244321 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c3141406-8758-4270-9570-0951b17c6366 tempest-VolumesActionsTest-1926207285 tempest-VolumesActionsTest-1926207285-project] 10.222.0.59 "GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a" status: 404 len: 111 microversion: 2.1 time: 0.032624 Aug 17 19:41:33.244865 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 181/375] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:33 2022] GET /compute/v2.1/servers/c6b9d664-2c4c-453b-8859-b36d62f08a3a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:41:33.280599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-44eb9235-e39d-497c-bb26-e1eeee298428 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:33.281346 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-44eb9235-e39d-497c-bb26-e1eeee298428 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:33.288716 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-44eb9235-e39d-497c-bb26-e1eeee298428 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:33.289537 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-44eb9235-e39d-497c-bb26-e1eeee298428 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:33.290578 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-44eb9235-e39d-497c-bb26-e1eeee298428 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:33.291277 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-44eb9235-e39d-497c-bb26-e1eeee298428 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:33.291727 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-44eb9235-e39d-497c-bb26-e1eeee298428 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:33.292144 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-44eb9235-e39d-497c-bb26-e1eeee298428 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:33.469130 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-44eb9235-e39d-497c-bb26-e1eeee298428 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:33.478983 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-44eb9235-e39d-497c-bb26-e1eeee298428 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1465 microversion: 2.1 time: 0.203013 Aug 17 19:41:33.480150 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 195/376] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:33 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1465 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:33.538276 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c0221ef5-de99-410b-b47e-c1280dd1e93b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:33.539010 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c0221ef5-de99-410b-b47e-c1280dd1e93b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:33.545730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0221ef5-de99-410b-b47e-c1280dd1e93b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:33.546214 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0221ef5-de99-410b-b47e-c1280dd1e93b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:33.546828 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0221ef5-de99-410b-b47e-c1280dd1e93b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:33.547817 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0221ef5-de99-410b-b47e-c1280dd1e93b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:33.548427 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0221ef5-de99-410b-b47e-c1280dd1e93b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:33.549001 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0221ef5-de99-410b-b47e-c1280dd1e93b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:33.569506 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:33.583532 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d7ddb866-668f-427d-8939-e28f358f10ce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:33.584146 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d7ddb866-668f-427d-8939-e28f358f10ce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:33.595523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d7ddb866-668f-427d-8939-e28f358f10ce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:33.596017 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d7ddb866-668f-427d-8939-e28f358f10ce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:33.596451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d7ddb866-668f-427d-8939-e28f358f10ce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:33.597149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d7ddb866-668f-427d-8939-e28f358f10ce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:33.597702 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d7ddb866-668f-427d-8939-e28f358f10ce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:33.598126 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d7ddb866-668f-427d-8939-e28f358f10ce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:33.607559 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c0221ef5-de99-410b-b47e-c1280dd1e93b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Going to try to terminate instance {{(pid=132530) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:41:33.752588 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c0221ef5-de99-410b-b47e-c1280dd1e93b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "DELETE /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 204 len: 0 microversion: 2.1 time: 0.217772 Aug 17 19:41:33.753870 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 182/377] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:41:33 2022] DELETE /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:41:33.763921 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f690e7be-d70e-46a2-a9d5-2103773016f4 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:33.764797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f690e7be-d70e-46a2-a9d5-2103773016f4 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:33.772298 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f690e7be-d70e-46a2-a9d5-2103773016f4 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:33.772947 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f690e7be-d70e-46a2-a9d5-2103773016f4 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:33.773576 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f690e7be-d70e-46a2-a9d5-2103773016f4 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:33.775010 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f690e7be-d70e-46a2-a9d5-2103773016f4 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:33.775617 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f690e7be-d70e-46a2-a9d5-2103773016f4 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:33.776223 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f690e7be-d70e-46a2-a9d5-2103773016f4 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:33.805917 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d7ddb866-668f-427d-8939-e28f358f10ce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:33.814319 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d7ddb866-668f-427d-8939-e28f358f10ce tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.234353 Aug 17 19:41:33.826154 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 196/378] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:33 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:33.831913 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4fcd3cd7-0bbe-4877-b906-63a306d3d70b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:33.832596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-4fcd3cd7-0bbe-4877-b906-63a306d3d70b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:33.838959 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4fcd3cd7-0bbe-4877-b906-63a306d3d70b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:33.839659 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4fcd3cd7-0bbe-4877-b906-63a306d3d70b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:33.840095 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4fcd3cd7-0bbe-4877-b906-63a306d3d70b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:33.842251 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4fcd3cd7-0bbe-4877-b906-63a306d3d70b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:33.842732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4fcd3cd7-0bbe-4877-b906-63a306d3d70b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:33.843170 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4fcd3cd7-0bbe-4877-b906-63a306d3d70b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:33.892150 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=6 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:33.991610 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f690e7be-d70e-46a2-a9d5-2103773016f4 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:34.001760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f690e7be-d70e-46a2-a9d5-2103773016f4 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1471 microversion: 2.1 time: 0.242844 Aug 17 19:41:34.002559 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 183/379] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:33 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:34.014047 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4fcd3cd7-0bbe-4877-b906-63a306d3d70b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:34.024966 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4fcd3cd7-0bbe-4877-b906-63a306d3d70b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:34.026624 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4fcd3cd7-0bbe-4877-b906-63a306d3d70b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:34.027953 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-4fcd3cd7-0bbe-4877-b906-63a306d3d70b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1720 microversion: 2.20 time: 0.200557 Aug 17 19:41:34.028520 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 197/380] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:33 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1720 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:34.846406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-908137d7-fdf5-49f4-8fff-e1f25b162688 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:34.846930 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-908137d7-fdf5-49f4-8fff-e1f25b162688 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:34.853382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-908137d7-fdf5-49f4-8fff-e1f25b162688 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:34.853872 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-908137d7-fdf5-49f4-8fff-e1f25b162688 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:34.854313 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-908137d7-fdf5-49f4-8fff-e1f25b162688 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:34.855006 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-908137d7-fdf5-49f4-8fff-e1f25b162688 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:34.855460 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-908137d7-fdf5-49f4-8fff-e1f25b162688 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:34.855882 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-908137d7-fdf5-49f4-8fff-e1f25b162688 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:34.983743 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-908137d7-fdf5-49f4-8fff-e1f25b162688 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:34.991200 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-908137d7-fdf5-49f4-8fff-e1f25b162688 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.148789 Aug 17 19:41:34.991754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 184/381] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:34 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:35.022599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1061c229-d36e-4307-ab45-c8ff4fd9ddb0 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:35.023212 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1061c229-d36e-4307-ab45-c8ff4fd9ddb0 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:35.030233 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1061c229-d36e-4307-ab45-c8ff4fd9ddb0 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:35.030716 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1061c229-d36e-4307-ab45-c8ff4fd9ddb0 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:35.031151 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1061c229-d36e-4307-ab45-c8ff4fd9ddb0 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:35.031830 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1061c229-d36e-4307-ab45-c8ff4fd9ddb0 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:35.032405 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1061c229-d36e-4307-ab45-c8ff4fd9ddb0 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:35.032829 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1061c229-d36e-4307-ab45-c8ff4fd9ddb0 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:35.050808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5d57d9e4-cd56-4920-bd7d-6b664f20058d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:35.051414 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5d57d9e4-cd56-4920-bd7d-6b664f20058d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:35.057171 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d57d9e4-cd56-4920-bd7d-6b664f20058d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:35.057685 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d57d9e4-cd56-4920-bd7d-6b664f20058d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:35.058177 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d57d9e4-cd56-4920-bd7d-6b664f20058d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:35.058871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d57d9e4-cd56-4920-bd7d-6b664f20058d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:35.059326 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d57d9e4-cd56-4920-bd7d-6b664f20058d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:35.059752 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d57d9e4-cd56-4920-bd7d-6b664f20058d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:35.225783 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1061c229-d36e-4307-ab45-c8ff4fd9ddb0 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:35.232689 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5d57d9e4-cd56-4920-bd7d-6b664f20058d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:35.233263 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1061c229-d36e-4307-ab45-c8ff4fd9ddb0 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1471 microversion: 2.1 time: 0.214496 Aug 17 19:41:35.233839 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 198/382] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:35 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1471 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:35.240783 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5d57d9e4-cd56-4920-bd7d-6b664f20058d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:35.242312 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5d57d9e4-cd56-4920-bd7d-6b664f20058d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:35.243465 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5d57d9e4-cd56-4920-bd7d-6b664f20058d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1720 microversion: 2.20 time: 0.196553 Aug 17 19:41:35.244008 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 185/383] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:35 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1720 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:41:36.011701 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-76cb3ba8-c3f6-4ef4-891a-a38e21f74c5d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:36.012316 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-76cb3ba8-c3f6-4ef4-891a-a38e21f74c5d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:36.018238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-76cb3ba8-c3f6-4ef4-891a-a38e21f74c5d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:36.018718 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-76cb3ba8-c3f6-4ef4-891a-a38e21f74c5d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:36.019153 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-76cb3ba8-c3f6-4ef4-891a-a38e21f74c5d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:36.019840 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-76cb3ba8-c3f6-4ef4-891a-a38e21f74c5d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:36.020296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-76cb3ba8-c3f6-4ef4-891a-a38e21f74c5d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:36.020721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-76cb3ba8-c3f6-4ef4-891a-a38e21f74c5d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:36.149639 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-76cb3ba8-c3f6-4ef4-891a-a38e21f74c5d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:36.157819 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-76cb3ba8-c3f6-4ef4-891a-a38e21f74c5d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.150027 Aug 17 19:41:36.158380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 199/384] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:36 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:36.255576 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-39ea28d0-9dec-4053-a2bf-8ead6f06f2c2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:36.256120 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-39ea28d0-9dec-4053-a2bf-8ead6f06f2c2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:36.263234 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-39ea28d0-9dec-4053-a2bf-8ead6f06f2c2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:36.263726 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-39ea28d0-9dec-4053-a2bf-8ead6f06f2c2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:36.264191 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-39ea28d0-9dec-4053-a2bf-8ead6f06f2c2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:36.264907 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-39ea28d0-9dec-4053-a2bf-8ead6f06f2c2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:36.265419 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-39ea28d0-9dec-4053-a2bf-8ead6f06f2c2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:36.265845 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-39ea28d0-9dec-4053-a2bf-8ead6f06f2c2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:36.266389 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0f455d4c-6235-4883-a27c-1fc95fa9d8f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:36.267002 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0f455d4c-6235-4883-a27c-1fc95fa9d8f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:36.272782 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f455d4c-6235-4883-a27c-1fc95fa9d8f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:36.273297 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f455d4c-6235-4883-a27c-1fc95fa9d8f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:36.273735 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f455d4c-6235-4883-a27c-1fc95fa9d8f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:36.274420 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f455d4c-6235-4883-a27c-1fc95fa9d8f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:36.274873 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f455d4c-6235-4883-a27c-1fc95fa9d8f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:36.275292 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f455d4c-6235-4883-a27c-1fc95fa9d8f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:36.454710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-39ea28d0-9dec-4053-a2bf-8ead6f06f2c2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:36.462193 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-39ea28d0-9dec-4053-a2bf-8ead6f06f2c2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1471 microversion: 2.1 time: 0.210569 Aug 17 19:41:36.463154 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 186/385] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:36 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:36.466308 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0f455d4c-6235-4883-a27c-1fc95fa9d8f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:36.474280 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0f455d4c-6235-4883-a27c-1fc95fa9d8f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:36.475919 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0f455d4c-6235-4883-a27c-1fc95fa9d8f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:36.477080 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0f455d4c-6235-4883-a27c-1fc95fa9d8f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1720 microversion: 2.20 time: 0.214536 Aug 17 19:41:36.477640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 200/386] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:36 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:41:37.178535 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-20323e96-6222-4a6a-9c3d-c5389280f64b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:37.179145 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-20323e96-6222-4a6a-9c3d-c5389280f64b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:37.185772 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-20323e96-6222-4a6a-9c3d-c5389280f64b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:37.186248 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-20323e96-6222-4a6a-9c3d-c5389280f64b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:37.186676 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-20323e96-6222-4a6a-9c3d-c5389280f64b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:37.187429 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-20323e96-6222-4a6a-9c3d-c5389280f64b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:37.187882 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-20323e96-6222-4a6a-9c3d-c5389280f64b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:37.188305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-20323e96-6222-4a6a-9c3d-c5389280f64b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:37.317712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-20323e96-6222-4a6a-9c3d-c5389280f64b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:37.326546 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-20323e96-6222-4a6a-9c3d-c5389280f64b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.151809 Aug 17 19:41:37.327105 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 187/387] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:37 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:37.484072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-bda70422-9588-4a1e-9d6a-42732cad950b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:37.484688 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-bda70422-9588-4a1e-9d6a-42732cad950b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:37.491785 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bda70422-9588-4a1e-9d6a-42732cad950b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:37.492260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bda70422-9588-4a1e-9d6a-42732cad950b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:37.492701 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bda70422-9588-4a1e-9d6a-42732cad950b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:37.493417 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bda70422-9588-4a1e-9d6a-42732cad950b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:37.493876 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bda70422-9588-4a1e-9d6a-42732cad950b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:37.494303 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bda70422-9588-4a1e-9d6a-42732cad950b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:37.498238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=100 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:37.499227 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6ddb6a48-1961-4176-9c24-f31ab2ea5ff6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:37.499885 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-6ddb6a48-1961-4176-9c24-f31ab2ea5ff6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:37.505870 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6ddb6a48-1961-4176-9c24-f31ab2ea5ff6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:37.506351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6ddb6a48-1961-4176-9c24-f31ab2ea5ff6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:37.506813 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6ddb6a48-1961-4176-9c24-f31ab2ea5ff6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:37.507507 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6ddb6a48-1961-4176-9c24-f31ab2ea5ff6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:37.507957 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6ddb6a48-1961-4176-9c24-f31ab2ea5ff6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:37.508376 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6ddb6a48-1961-4176-9c24-f31ab2ea5ff6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:37.694542 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-bda70422-9588-4a1e-9d6a-42732cad950b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:37.702769 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-bda70422-9588-4a1e-9d6a-42732cad950b tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1471 microversion: 2.1 time: 0.223126 Aug 17 19:41:37.703367 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 201/388] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:37 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1471 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:37.704890 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6ddb6a48-1961-4176-9c24-f31ab2ea5ff6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:37.712813 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6ddb6a48-1961-4176-9c24-f31ab2ea5ff6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:37.714934 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6ddb6a48-1961-4176-9c24-f31ab2ea5ff6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:37.716176 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-6ddb6a48-1961-4176-9c24-f31ab2ea5ff6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1720 microversion: 2.20 time: 0.220931 Aug 17 19:41:37.716799 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 188/389] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:37 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:38.228810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-459891d9-5cef-4d86-96b2-11b714185f7f req-b70f56a4-eb63-44f1-ba38-8b66d9cc1e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb", "name": "network-vif-plugged", "status": "completed", "tag": "bf5dc59e-079d-4504-b553-f9c0418123e9"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:38.238820 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-459891d9-5cef-4d86-96b2-11b714185f7f req-b70f56a4-eb63-44f1-ba38-8b66d9cc1e32 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:38.239301 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-459891d9-5cef-4d86-96b2-11b714185f7f req-b70f56a4-eb63-44f1-ba38-8b66d9cc1e32 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:38.239736 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-459891d9-5cef-4d86-96b2-11b714185f7f req-b70f56a4-eb63-44f1-ba38-8b66d9cc1e32 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:38.252734 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-459891d9-5cef-4d86-96b2-11b714185f7f req-b70f56a4-eb63-44f1-ba38-8b66d9cc1e32 service nova] Creating event network-vif-plugged:bf5dc59e-079d-4504-b553-f9c0418123e9 for instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb on hv-cinder-85069 Aug 17 19:41:38.257829 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-459891d9-5cef-4d86-96b2-11b714185f7f req-b70f56a4-eb63-44f1-ba38-8b66d9cc1e32 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032722 Aug 17 19:41:38.258425 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 202/390] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:38.347413 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-863bfb9e-5291-4328-aa10-93be4e67119f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:38.347963 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-863bfb9e-5291-4328-aa10-93be4e67119f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:38.354336 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-863bfb9e-5291-4328-aa10-93be4e67119f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:38.354821 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-863bfb9e-5291-4328-aa10-93be4e67119f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:38.355253 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-863bfb9e-5291-4328-aa10-93be4e67119f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:38.355933 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-863bfb9e-5291-4328-aa10-93be4e67119f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:38.356385 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-863bfb9e-5291-4328-aa10-93be4e67119f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:38.356806 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-863bfb9e-5291-4328-aa10-93be4e67119f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:38.486349 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-863bfb9e-5291-4328-aa10-93be4e67119f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:38.493767 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-863bfb9e-5291-4328-aa10-93be4e67119f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.150258 Aug 17 19:41:38.494323 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 189/391] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:38 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:38.725461 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-752d5b71-7cf9-4cce-9a7d-e5cbe08bea72 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:38.728292 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-752d5b71-7cf9-4cce-9a7d-e5cbe08bea72 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:38.745047 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f8598530-7873-4ed4-bf75-85bb7d55e7bf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:38.746548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f8598530-7873-4ed4-bf75-85bb7d55e7bf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:38.755148 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-752d5b71-7cf9-4cce-9a7d-e5cbe08bea72 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:38.756491 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-752d5b71-7cf9-4cce-9a7d-e5cbe08bea72 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:38.757599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-752d5b71-7cf9-4cce-9a7d-e5cbe08bea72 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:38.758726 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-752d5b71-7cf9-4cce-9a7d-e5cbe08bea72 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:38.759718 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-752d5b71-7cf9-4cce-9a7d-e5cbe08bea72 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:38.764213 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-752d5b71-7cf9-4cce-9a7d-e5cbe08bea72 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:38.771199 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f8598530-7873-4ed4-bf75-85bb7d55e7bf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:38.773340 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f8598530-7873-4ed4-bf75-85bb7d55e7bf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:38.773801 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f8598530-7873-4ed4-bf75-85bb7d55e7bf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:38.774538 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f8598530-7873-4ed4-bf75-85bb7d55e7bf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:38.775033 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f8598530-7873-4ed4-bf75-85bb7d55e7bf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:38.775466 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f8598530-7873-4ed4-bf75-85bb7d55e7bf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:39.056974 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-752d5b71-7cf9-4cce-9a7d-e5cbe08bea72 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:39.067468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-752d5b71-7cf9-4cce-9a7d-e5cbe08bea72 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1471 microversion: 2.1 time: 0.346697 Aug 17 19:41:39.070022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 203/392] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:38 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1471 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:39.078109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f8598530-7873-4ed4-bf75-85bb7d55e7bf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:39.080205 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a5adf36f-4d06-44a4-982f-68f7daf00152 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:39.081026 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a5adf36f-4d06-44a4-982f-68f7daf00152 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:39.089740 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a5adf36f-4d06-44a4-982f-68f7daf00152 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:39.090771 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a5adf36f-4d06-44a4-982f-68f7daf00152 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:39.091410 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a5adf36f-4d06-44a4-982f-68f7daf00152 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:39.092366 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a5adf36f-4d06-44a4-982f-68f7daf00152 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:39.093039 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a5adf36f-4d06-44a4-982f-68f7daf00152 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:39.093760 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a5adf36f-4d06-44a4-982f-68f7daf00152 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:39.097411 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f8598530-7873-4ed4-bf75-85bb7d55e7bf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:39.105326 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f8598530-7873-4ed4-bf75-85bb7d55e7bf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:39.107315 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f8598530-7873-4ed4-bf75-85bb7d55e7bf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1720 microversion: 2.20 time: 0.371266 Aug 17 19:41:39.108630 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 190/393] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:38 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1720 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:39.265662 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a5adf36f-4d06-44a4-982f-68f7daf00152 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:39.274370 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a5adf36f-4d06-44a4-982f-68f7daf00152 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1594 microversion: 2.1 time: 0.202204 Aug 17 19:41:39.275531 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 204/394] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:39 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1594 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:39.349528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-41190615-6b05-4512-a020-116437371850 req-12a84676-5d9a-4c31-86a1-904792e6c8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93ae0457-5029-49a2-9182-4124ba6b015f", "name": "network-vif-deleted", "tag": "6c9849e7-051b-4d58-899b-fcadcef2f78d"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:39.363073 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-41190615-6b05-4512-a020-116437371850 req-12a84676-5d9a-4c31-86a1-904792e6c8b8 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:39.364495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-41190615-6b05-4512-a020-116437371850 req-12a84676-5d9a-4c31-86a1-904792e6c8b8 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:39.365968 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-41190615-6b05-4512-a020-116437371850 req-12a84676-5d9a-4c31-86a1-904792e6c8b8 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:39.384485 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-41190615-6b05-4512-a020-116437371850 req-12a84676-5d9a-4c31-86a1-904792e6c8b8 service nova] Creating event network-vif-deleted:6c9849e7-051b-4d58-899b-fcadcef2f78d for instance 93ae0457-5029-49a2-9182-4124ba6b015f on hv-cinder-85069 Aug 17 19:41:39.392052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-41190615-6b05-4512-a020-116437371850 req-12a84676-5d9a-4c31-86a1-904792e6c8b8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046286 Aug 17 19:41:39.393314 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 191/395] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:39.527847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9193102c-f524-439f-9877-fd3e52d51edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:39.528474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9193102c-f524-439f-9877-fd3e52d51edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:39.550455 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9193102c-f524-439f-9877-fd3e52d51edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:39.551355 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9193102c-f524-439f-9877-fd3e52d51edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:39.553064 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9193102c-f524-439f-9877-fd3e52d51edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:39.554236 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9193102c-f524-439f-9877-fd3e52d51edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:39.554983 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9193102c-f524-439f-9877-fd3e52d51edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:39.555640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9193102c-f524-439f-9877-fd3e52d51edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:39.821923 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9193102c-f524-439f-9877-fd3e52d51edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:39.833281 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9193102c-f524-439f-9877-fd3e52d51edb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.321988 Aug 17 19:41:39.833953 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 205/396] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:39 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:40.093452 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-bb0dffff-69d4-460a-97ff-c84091e12aae tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:40.094373 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-bb0dffff-69d4-460a-97ff-c84091e12aae tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:40.105959 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb0dffff-69d4-460a-97ff-c84091e12aae tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:40.106807 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb0dffff-69d4-460a-97ff-c84091e12aae tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:40.107435 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb0dffff-69d4-460a-97ff-c84091e12aae tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:40.108327 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb0dffff-69d4-460a-97ff-c84091e12aae tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:40.108960 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb0dffff-69d4-460a-97ff-c84091e12aae tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:40.109607 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb0dffff-69d4-460a-97ff-c84091e12aae tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:40.131865 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d4ec7f85-5ffe-4e9e-9527-ca82781755b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:40.133067 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d4ec7f85-5ffe-4e9e-9527-ca82781755b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:40.141629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4ec7f85-5ffe-4e9e-9527-ca82781755b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:40.142572 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4ec7f85-5ffe-4e9e-9527-ca82781755b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:40.144710 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4ec7f85-5ffe-4e9e-9527-ca82781755b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:40.150445 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4ec7f85-5ffe-4e9e-9527-ca82781755b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:40.152430 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4ec7f85-5ffe-4e9e-9527-ca82781755b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:40.154326 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4ec7f85-5ffe-4e9e-9527-ca82781755b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:40.248969 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-bb0dffff-69d4-460a-97ff-c84091e12aae tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:40.288927 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-bb0dffff-69d4-460a-97ff-c84091e12aae tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1429 microversion: 2.1 time: 0.192998 Aug 17 19:41:40.290700 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 192/397] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:40 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1429 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:40.309627 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-773a9e03-4ee6-4b1d-83cd-a6c0a2fb8627 req-25e4d314-1b7a-4535-9e38-4aadaa0505bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04daa67-36a6-4a53-b80a-e90f77348028", "name": "network-vif-unplugged", "status": "completed", "tag": "8692c85c-fc9f-49cd-bff2-6ddd975dd053"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:40.323503 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-773a9e03-4ee6-4b1d-83cd-a6c0a2fb8627 req-25e4d314-1b7a-4535-9e38-4aadaa0505bf service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:40.324301 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-773a9e03-4ee6-4b1d-83cd-a6c0a2fb8627 req-25e4d314-1b7a-4535-9e38-4aadaa0505bf service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:40.326566 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-773a9e03-4ee6-4b1d-83cd-a6c0a2fb8627 req-25e4d314-1b7a-4535-9e38-4aadaa0505bf service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:40.344125 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-773a9e03-4ee6-4b1d-83cd-a6c0a2fb8627 req-25e4d314-1b7a-4535-9e38-4aadaa0505bf service nova] Creating event network-vif-unplugged:8692c85c-fc9f-49cd-bff2-6ddd975dd053 for instance b04daa67-36a6-4a53-b80a-e90f77348028 on hv-cinder-85069 Aug 17 19:41:40.349523 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-773a9e03-4ee6-4b1d-83cd-a6c0a2fb8627 req-25e4d314-1b7a-4535-9e38-4aadaa0505bf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046733 Aug 17 19:41:40.351783 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 193/398] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:40.532763 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d4ec7f85-5ffe-4e9e-9527-ca82781755b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:40.542620 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d4ec7f85-5ffe-4e9e-9527-ca82781755b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:40.544493 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d4ec7f85-5ffe-4e9e-9527-ca82781755b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:40.546214 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d4ec7f85-5ffe-4e9e-9527-ca82781755b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1720 microversion: 2.20 time: 0.418135 Aug 17 19:41:40.561065 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 206/399] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:40 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1720 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:40.859203 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-11520726-cd91-47a6-928d-751118897bec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:40.860423 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-11520726-cd91-47a6-928d-751118897bec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:40.867689 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-11520726-cd91-47a6-928d-751118897bec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:40.868128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-11520726-cd91-47a6-928d-751118897bec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:40.868819 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-11520726-cd91-47a6-928d-751118897bec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:40.871309 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-11520726-cd91-47a6-928d-751118897bec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:40.872006 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-11520726-cd91-47a6-928d-751118897bec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:40.872646 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-11520726-cd91-47a6-928d-751118897bec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:41.330704 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b6c15500-cbbc-48e6-a982-57c6fedc0501 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:41.332298 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b6c15500-cbbc-48e6-a982-57c6fedc0501 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:41.356107 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6c15500-cbbc-48e6-a982-57c6fedc0501 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:41.365436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6c15500-cbbc-48e6-a982-57c6fedc0501 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:41.368884 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6c15500-cbbc-48e6-a982-57c6fedc0501 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:41.368884 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6c15500-cbbc-48e6-a982-57c6fedc0501 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:41.368884 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6c15500-cbbc-48e6-a982-57c6fedc0501 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:41.368884 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6c15500-cbbc-48e6-a982-57c6fedc0501 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:41.501878 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-11520726-cd91-47a6-928d-751118897bec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:41.512085 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-11520726-cd91-47a6-928d-751118897bec tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1372 microversion: 2.1 time: 0.658741 Aug 17 19:41:41.513426 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 194/400] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:40 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1372 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:41.540480 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b6c15500-cbbc-48e6-a982-57c6fedc0501 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:41.563102 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b6c15500-cbbc-48e6-a982-57c6fedc0501 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1300 microversion: 2.1 time: 0.236509 Aug 17 19:41:41.563802 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 207/401] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:41 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1300 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:41.570729 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6b60443f-61c0-4f02-9e5f-fddfff4b15ff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:41.571354 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-6b60443f-61c0-4f02-9e5f-fddfff4b15ff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:41.583321 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6b60443f-61c0-4f02-9e5f-fddfff4b15ff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:41.584091 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6b60443f-61c0-4f02-9e5f-fddfff4b15ff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:41.584730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6b60443f-61c0-4f02-9e5f-fddfff4b15ff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:41.586204 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6b60443f-61c0-4f02-9e5f-fddfff4b15ff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:41.586685 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6b60443f-61c0-4f02-9e5f-fddfff4b15ff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:41.587129 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6b60443f-61c0-4f02-9e5f-fddfff4b15ff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:41.857810 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6b60443f-61c0-4f02-9e5f-fddfff4b15ff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:41.880107 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6b60443f-61c0-4f02-9e5f-fddfff4b15ff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:41.882226 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6b60443f-61c0-4f02-9e5f-fddfff4b15ff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:41.883646 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-6b60443f-61c0-4f02-9e5f-fddfff4b15ff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1723 microversion: 2.20 time: 0.316947 Aug 17 19:41:41.884207 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 195/402] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:41 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:41.909849 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-df28ab59-2dbf-4dd7-9a21-935652058f49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68c27d4b-0168-4520-9622-d39f03b20cb7"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:41.913670 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-df28ab59-2dbf-4dd7-9a21-935652058f49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:41.925365 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:41.929325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-df28ab59-2dbf-4dd7-9a21-935652058f49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:41.930043 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-df28ab59-2dbf-4dd7-9a21-935652058f49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:41.933499 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-df28ab59-2dbf-4dd7-9a21-935652058f49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:41.934439 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-df28ab59-2dbf-4dd7-9a21-935652058f49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:41.938886 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-df28ab59-2dbf-4dd7-9a21-935652058f49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:41.939546 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-df28ab59-2dbf-4dd7-9a21-935652058f49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:42.376619 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-df28ab59-2dbf-4dd7-9a21-935652058f49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "POST /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.460912 Aug 17 19:41:42.383096 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 208/403] 10.222.0.59 () {62 vars in 1364 bytes} [Wed Aug 17 19:41:41 2022] POST /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/os-volume_attachments => generated 188 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:41:42.445406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-9acaaa36-e752-4e92-b297-60ceff96785b req-aa2e37d8-b955-413e-944e-883424b43a0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee39152-962e-4cdf-8251-15b138a12dcc", "tag": "b5880430-ff15-4906-82f8-7fe7ec8aba19"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:42.457807 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-9acaaa36-e752-4e92-b297-60ceff96785b req-aa2e37d8-b955-413e-944e-883424b43a0b service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:42.458288 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-9acaaa36-e752-4e92-b297-60ceff96785b req-aa2e37d8-b955-413e-944e-883424b43a0b service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:42.458766 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-9acaaa36-e752-4e92-b297-60ceff96785b req-aa2e37d8-b955-413e-944e-883424b43a0b service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:42.497440 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-9acaaa36-e752-4e92-b297-60ceff96785b req-aa2e37d8-b955-413e-944e-883424b43a0b service nova] Creating event network-changed:b5880430-ff15-4906-82f8-7fe7ec8aba19 for instance 9ee39152-962e-4cdf-8251-15b138a12dcc on hv-cinder-85069 Aug 17 19:41:42.520152 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-9acaaa36-e752-4e92-b297-60ceff96785b req-aa2e37d8-b955-413e-944e-883424b43a0b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083628 Aug 17 19:41:42.525384 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 196/404] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:41:42.533985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-59f13a48-fab4-467d-be20-57d7d27d1025 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:42.534848 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-59f13a48-fab4-467d-be20-57d7d27d1025 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:42.544141 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59f13a48-fab4-467d-be20-57d7d27d1025 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:42.544878 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59f13a48-fab4-467d-be20-57d7d27d1025 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:42.545633 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59f13a48-fab4-467d-be20-57d7d27d1025 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:42.546808 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59f13a48-fab4-467d-be20-57d7d27d1025 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:42.547365 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59f13a48-fab4-467d-be20-57d7d27d1025 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:42.547896 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59f13a48-fab4-467d-be20-57d7d27d1025 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:42.589472 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:42.589472 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:42.606148 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:42.606621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:42.607028 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:42.607803 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:42.608266 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:42.608715 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:42.675959 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:42.676770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:42.677428 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:42.678070 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lazy-loading 'fault' on Instance uuid 93ae0457-5029-49a2-9182-4124ba6b015f {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:41:42.788450 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fcb708d5e474aa185615724573e8fe9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec6d3773e5384bfdadf6673f61ca5959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:42.803546 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-cc12a51d-9f63-4591-a4df-ebab468451a2 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 200 len: 1305 microversion: 2.1 time: 0.220206 Aug 17 19:41:42.804140 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 197/405] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:42 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 1305 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:41:42.819549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-daa37e62-adb7-4a3e-a123-55eee9ff8c7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:42.823075 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-daa37e62-adb7-4a3e-a123-55eee9ff8c7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:42.840361 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-daa37e62-adb7-4a3e-a123-55eee9ff8c7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:42.841028 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-daa37e62-adb7-4a3e-a123-55eee9ff8c7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:42.843639 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-daa37e62-adb7-4a3e-a123-55eee9ff8c7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:42.844592 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-daa37e62-adb7-4a3e-a123-55eee9ff8c7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:42.847446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-daa37e62-adb7-4a3e-a123-55eee9ff8c7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:42.848082 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-daa37e62-adb7-4a3e-a123-55eee9ff8c7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:42.874726 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-59f13a48-fab4-467d-be20-57d7d27d1025 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:42.886430 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-59f13a48-fab4-467d-be20-57d7d27d1025 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1567 microversion: 2.1 time: 0.354420 Aug 17 19:41:42.888676 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 209/406] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:42 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1567 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:42.913560 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-054ec818-c361-4285-a01a-706c0cf41262 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:42.919172 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-054ec818-c361-4285-a01a-706c0cf41262 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:42.938660 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-054ec818-c361-4285-a01a-706c0cf41262 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:42.939465 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-054ec818-c361-4285-a01a-706c0cf41262 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:42.940358 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-054ec818-c361-4285-a01a-706c0cf41262 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:42.941534 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-054ec818-c361-4285-a01a-706c0cf41262 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:42.942217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-054ec818-c361-4285-a01a-706c0cf41262 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:42.942868 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-054ec818-c361-4285-a01a-706c0cf41262 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:42.957433 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-daa37e62-adb7-4a3e-a123-55eee9ff8c7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132530) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 19:41:43.007032 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:43.078729 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-daa37e62-adb7-4a3e-a123-55eee9ff8c7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "POST /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/action" status: 202 len: 0 microversion: 2.20 time: 0.268853 Aug 17 19:41:43.078976 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-054ec818-c361-4285-a01a-706c0cf41262 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.172637 Aug 17 19:41:43.079913 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 210/407] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 17 19:41:42 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:43.081041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 198/408] 10.222.0.59 () {62 vars in 1319 bytes} [Wed Aug 17 19:41:42 2022] POST /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:41:43.088865 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5f518fb5-f96e-40a6-823d-9f6edfd957aa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:43.089584 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5f518fb5-f96e-40a6-823d-9f6edfd957aa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:43.116580 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5f518fb5-f96e-40a6-823d-9f6edfd957aa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:43.118249 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5f518fb5-f96e-40a6-823d-9f6edfd957aa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:43.119334 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5f518fb5-f96e-40a6-823d-9f6edfd957aa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:43.121278 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5f518fb5-f96e-40a6-823d-9f6edfd957aa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:43.122215 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5f518fb5-f96e-40a6-823d-9f6edfd957aa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:43.124307 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5f518fb5-f96e-40a6-823d-9f6edfd957aa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:43.500785 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5f518fb5-f96e-40a6-823d-9f6edfd957aa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:43.513170 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5f518fb5-f96e-40a6-823d-9f6edfd957aa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:43.519335 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5f518fb5-f96e-40a6-823d-9f6edfd957aa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:43.520629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5f518fb5-f96e-40a6-823d-9f6edfd957aa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1749 microversion: 2.20 time: 0.435573 Aug 17 19:41:43.524280 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 211/409] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:43 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1749 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:41:43.828175 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3e665458-c28d-4e02-914d-acdd7d65c114 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:43.828799 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3e665458-c28d-4e02-914d-acdd7d65c114 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] [instance: 93ae0457-5029-49a2-9182-4124ba6b015f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:43.842409 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3e665458-c28d-4e02-914d-acdd7d65c114 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:43.844408 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3e665458-c28d-4e02-914d-acdd7d65c114 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:43.846196 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3e665458-c28d-4e02-914d-acdd7d65c114 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:43.847337 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3e665458-c28d-4e02-914d-acdd7d65c114 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:43.849174 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3e665458-c28d-4e02-914d-acdd7d65c114 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:43.850919 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3e665458-c28d-4e02-914d-acdd7d65c114 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:43.880751 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-3e665458-c28d-4e02-914d-acdd7d65c114 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] HTTP exception thrown: Instance 93ae0457-5029-49a2-9182-4124ba6b015f could not be found. Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3e665458-c28d-4e02-914d-acdd7d65c114 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Request method failure captured: Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f HTTP/1.1 Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_URZlNIfHdq9VS9WbLKpPFdJEj5BW1LTyFDGk8MXGWwQZIqD2efxBxKCh_-l-tZzSQDbErOgRafMp78kJ59sNFrfvXkot1cmj_2nQDKy9qS2zp17pFqFoEu4Pkok9zF4X9Npfzf72TjCvWvVaNPucG0Pmk16LEbv0q6OFyIs-Hy-8Zw Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: ec6d3773e5384bfdadf6673f61ca5959 Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-VolumesNegativeTest-1087699721 Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:41:43.889754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:41:43.891169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec6d3773e5384bfdadf6673f61ca5959"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec6d3773e5384bfdadf6673f61ca5959"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec6d3773e5384bfdadf6673f61ca5959", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec6d3773e5384bfdadf6673f61ca5959"}]}] Aug 17 19:41:43.891169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-VolumesNegativeTest-1087699721 Aug 17 19:41:43.891169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: ec6d3773e5384bfdadf6673f61ca5959 Aug 17 19:41:43.891169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-VolumesNegativeTest-1087699721 Aug 17 19:41:43.891169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-VolumesNegativeTest-1087699721-project Aug 17 19:41:43.891169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:41:43.891169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:41:43.891169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 6fcb708d5e474aa185615724573e8fe9 Aug 17 19:41:43.891169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-VolumesNegativeTest-1087699721-project Aug 17 19:41:43.891169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:41:43.891169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 93ae0457-5029-49a2-9182-4124ba6b015f could not be found. Aug 17 19:41:43.891169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '93ae0457-5029-49a2-9182-4124ba6b015f'} Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93ae0457-5029-49a2-9182-4124ba6b015f could not be found. Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:41:43.891908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93ae0457-5029-49a2-9182-4124ba6b015f could not be found. Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93ae0457-5029-49a2-9182-4124ba6b015f could not be found. Aug 17 19:41:43.893123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:41:43.896410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3e665458-c28d-4e02-914d-acdd7d65c114 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] Returning 404 to user: Instance 93ae0457-5029-49a2-9182-4124ba6b015f could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:41:43.896410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3e665458-c28d-4e02-914d-acdd7d65c114 tempest-VolumesNegativeTest-1087699721 tempest-VolumesNegativeTest-1087699721-project] 10.222.0.59 "GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f" status: 404 len: 111 microversion: 2.1 time: 0.067312 Aug 17 19:41:43.896410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 199/410] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:43 2022] GET /compute/v2.1/servers/93ae0457-5029-49a2-9182-4124ba6b015f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:41:44.543984 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e727aee1-f4d7-42ed-aa14-5325e62e981b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:44.544587 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e727aee1-f4d7-42ed-aa14-5325e62e981b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:44.556457 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e727aee1-f4d7-42ed-aa14-5325e62e981b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:44.556786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e727aee1-f4d7-42ed-aa14-5325e62e981b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:44.557236 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e727aee1-f4d7-42ed-aa14-5325e62e981b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:44.561028 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e727aee1-f4d7-42ed-aa14-5325e62e981b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:44.563955 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e727aee1-f4d7-42ed-aa14-5325e62e981b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:44.564577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e727aee1-f4d7-42ed-aa14-5325e62e981b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:44.814806 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e727aee1-f4d7-42ed-aa14-5325e62e981b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:44.830328 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e727aee1-f4d7-42ed-aa14-5325e62e981b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:44.834072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e727aee1-f4d7-42ed-aa14-5325e62e981b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:44.836541 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e727aee1-f4d7-42ed-aa14-5325e62e981b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1749 microversion: 2.20 time: 0.296391 Aug 17 19:41:44.852382 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 212/411] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:44 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1749 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:45.866852 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c8a3ff04-bccf-4790-965e-55ed7ae74217 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:45.868126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c8a3ff04-bccf-4790-965e-55ed7ae74217 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:45.884750 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8a3ff04-bccf-4790-965e-55ed7ae74217 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:45.885699 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8a3ff04-bccf-4790-965e-55ed7ae74217 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:45.886471 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8a3ff04-bccf-4790-965e-55ed7ae74217 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:45.887207 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8a3ff04-bccf-4790-965e-55ed7ae74217 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:45.887879 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8a3ff04-bccf-4790-965e-55ed7ae74217 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:45.888548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8a3ff04-bccf-4790-965e-55ed7ae74217 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:45.924843 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-025b5c75-6cba-45ee-9d06-c495101995d0 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-363925419"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:45.926165 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-025b5c75-6cba-45ee-9d06-c495101995d0 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:45.946103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-025b5c75-6cba-45ee-9d06-c495101995d0 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:45.946671 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-025b5c75-6cba-45ee-9d06-c495101995d0 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:45.947675 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-025b5c75-6cba-45ee-9d06-c495101995d0 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:45.949903 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-025b5c75-6cba-45ee-9d06-c495101995d0 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:45.950867 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-025b5c75-6cba-45ee-9d06-c495101995d0 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:45.951438 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-025b5c75-6cba-45ee-9d06-c495101995d0 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:46.270109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c8a3ff04-bccf-4790-965e-55ed7ae74217 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:46.295839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c8a3ff04-bccf-4790-965e-55ed7ae74217 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:46.297663 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c8a3ff04-bccf-4790-965e-55ed7ae74217 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:46.306661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c8a3ff04-bccf-4790-965e-55ed7ae74217 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1751 microversion: 2.20 time: 0.443784 Aug 17 19:41:46.307805 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.network.security_group_api [None req-025b5c75-6cba-45ee-9d06-c495101995d0 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Adding security group 672c29cc-b592-4fae-8a78-ce3997325e42 to port b5880430-ff15-4906-82f8-7fe7ec8aba19 Aug 17 19:41:46.309404 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 200/412] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:45 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1751 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:46.321099 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-64d9fa58-3d3e-40d6-b872-05c49c1587e6 req-11a37044-b9e8-49de-a36a-b1c505e06453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb", "tag": "bf5dc59e-079d-4504-b553-f9c0418123e9"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:46.343332 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-64d9fa58-3d3e-40d6-b872-05c49c1587e6 req-11a37044-b9e8-49de-a36a-b1c505e06453 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:46.346542 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-64d9fa58-3d3e-40d6-b872-05c49c1587e6 req-11a37044-b9e8-49de-a36a-b1c505e06453 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:46.349870 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-64d9fa58-3d3e-40d6-b872-05c49c1587e6 req-11a37044-b9e8-49de-a36a-b1c505e06453 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:46.373791 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-64d9fa58-3d3e-40d6-b872-05c49c1587e6 req-11a37044-b9e8-49de-a36a-b1c505e06453 service nova] Creating event network-changed:bf5dc59e-079d-4504-b553-f9c0418123e9 for instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb on hv-cinder-85069 Aug 17 19:41:46.381624 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-64d9fa58-3d3e-40d6-b872-05c49c1587e6 req-11a37044-b9e8-49de-a36a-b1c505e06453 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070123 Aug 17 19:41:46.382510 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 201/413] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:41:46.818116 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-025b5c75-6cba-45ee-9d06-c495101995d0 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "POST /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/action" status: 202 len: 0 microversion: 2.1 time: 0.897080 Aug 17 19:41:46.819171 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 213/414] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:41:45 2022] POST /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/action => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:41:46.828138 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2d794adf-9efe-4d63-8700-8a40d5a495cb tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:46.828839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2d794adf-9efe-4d63-8700-8a40d5a495cb tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:46.837332 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d794adf-9efe-4d63-8700-8a40d5a495cb tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:46.837824 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d794adf-9efe-4d63-8700-8a40d5a495cb tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:46.838255 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d794adf-9efe-4d63-8700-8a40d5a495cb tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:46.838995 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d794adf-9efe-4d63-8700-8a40d5a495cb tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:46.839443 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d794adf-9efe-4d63-8700-8a40d5a495cb tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:46.839864 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d794adf-9efe-4d63-8700-8a40d5a495cb tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:46.867060 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-a65d8531-384c-46ae-8092-519c1f2178d2 req-00cfaeb2-4943-42f6-9d2a-de316b694ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee39152-962e-4cdf-8251-15b138a12dcc", "tag": "b5880430-ff15-4906-82f8-7fe7ec8aba19"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:41:46.894742 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-a65d8531-384c-46ae-8092-519c1f2178d2 req-00cfaeb2-4943-42f6-9d2a-de316b694ab9 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:46.906308 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-a65d8531-384c-46ae-8092-519c1f2178d2 req-00cfaeb2-4943-42f6-9d2a-de316b694ab9 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:46.907649 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-a65d8531-384c-46ae-8092-519c1f2178d2 req-00cfaeb2-4943-42f6-9d2a-de316b694ab9 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:46.946725 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-a65d8531-384c-46ae-8092-519c1f2178d2 req-00cfaeb2-4943-42f6-9d2a-de316b694ab9 service nova] Creating event network-changed:b5880430-ff15-4906-82f8-7fe7ec8aba19 for instance 9ee39152-962e-4cdf-8251-15b138a12dcc on hv-cinder-85069 Aug 17 19:41:46.954325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-a65d8531-384c-46ae-8092-519c1f2178d2 req-00cfaeb2-4943-42f6-9d2a-de316b694ab9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093624 Aug 17 19:41:46.955508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 214/415] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:41:47.272045 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-2d794adf-9efe-4d63-8700-8a40d5a495cb tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:47.282333 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2d794adf-9efe-4d63-8700-8a40d5a495cb tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1759 microversion: 2.1 time: 0.458877 Aug 17 19:41:47.297713 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 202/416] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:41:46 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1759 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:41:47.337152 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-516e2391-5741-4078-b61d-76e1a5b72f31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:47.337975 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-516e2391-5741-4078-b61d-76e1a5b72f31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:47.347822 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-516e2391-5741-4078-b61d-76e1a5b72f31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:47.348734 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-516e2391-5741-4078-b61d-76e1a5b72f31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:47.349405 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-516e2391-5741-4078-b61d-76e1a5b72f31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:47.350269 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-516e2391-5741-4078-b61d-76e1a5b72f31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:47.350891 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-516e2391-5741-4078-b61d-76e1a5b72f31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:47.351470 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-516e2391-5741-4078-b61d-76e1a5b72f31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:47.699312 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-516e2391-5741-4078-b61d-76e1a5b72f31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:47.708650 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-516e2391-5741-4078-b61d-76e1a5b72f31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:47.715266 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-516e2391-5741-4078-b61d-76e1a5b72f31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:47.718225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-516e2391-5741-4078-b61d-76e1a5b72f31 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.385887 Aug 17 19:41:47.722611 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 215/417] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:47 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:48.748827 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d3c455c3-ba09-464d-a216-4cd94b4e514d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:48.749474 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d3c455c3-ba09-464d-a216-4cd94b4e514d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:48.765744 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:48.767984 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d3c455c3-ba09-464d-a216-4cd94b4e514d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:48.768735 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d3c455c3-ba09-464d-a216-4cd94b4e514d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:48.769666 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d3c455c3-ba09-464d-a216-4cd94b4e514d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:48.770757 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d3c455c3-ba09-464d-a216-4cd94b4e514d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:48.771423 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d3c455c3-ba09-464d-a216-4cd94b4e514d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:48.772133 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d3c455c3-ba09-464d-a216-4cd94b4e514d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:49.074143 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d3c455c3-ba09-464d-a216-4cd94b4e514d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:49.083740 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d3c455c3-ba09-464d-a216-4cd94b4e514d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:49.085300 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d3c455c3-ba09-464d-a216-4cd94b4e514d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:49.090390 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d3c455c3-ba09-464d-a216-4cd94b4e514d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.345494 Aug 17 19:41:49.091173 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 203/418] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:48 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:50.123136 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b0b14367-5ca7-4f5f-9e9a-f5c257f01b29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:50.123853 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b0b14367-5ca7-4f5f-9e9a-f5c257f01b29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:50.135888 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b0b14367-5ca7-4f5f-9e9a-f5c257f01b29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:50.136953 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b0b14367-5ca7-4f5f-9e9a-f5c257f01b29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:50.138661 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b0b14367-5ca7-4f5f-9e9a-f5c257f01b29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:50.139995 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b0b14367-5ca7-4f5f-9e9a-f5c257f01b29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:50.141166 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b0b14367-5ca7-4f5f-9e9a-f5c257f01b29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:50.142389 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b0b14367-5ca7-4f5f-9e9a-f5c257f01b29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:50.402816 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b0b14367-5ca7-4f5f-9e9a-f5c257f01b29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:50.417073 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b0b14367-5ca7-4f5f-9e9a-f5c257f01b29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:50.419576 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b0b14367-5ca7-4f5f-9e9a-f5c257f01b29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:50.424832 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b0b14367-5ca7-4f5f-9e9a-f5c257f01b29 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.308713 Aug 17 19:41:50.447149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 216/419] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:50 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:51.455349 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-855ecce7-b913-4d5f-a133-b37ff912942a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:51.456226 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-855ecce7-b913-4d5f-a133-b37ff912942a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:51.469405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-855ecce7-b913-4d5f-a133-b37ff912942a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:51.469774 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-855ecce7-b913-4d5f-a133-b37ff912942a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:51.470217 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-855ecce7-b913-4d5f-a133-b37ff912942a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:51.470923 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-855ecce7-b913-4d5f-a133-b37ff912942a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:51.471381 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-855ecce7-b913-4d5f-a133-b37ff912942a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:51.485283 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-855ecce7-b913-4d5f-a133-b37ff912942a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:51.675457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-855ecce7-b913-4d5f-a133-b37ff912942a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:51.687571 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-855ecce7-b913-4d5f-a133-b37ff912942a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:51.690088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-855ecce7-b913-4d5f-a133-b37ff912942a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:51.691964 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-855ecce7-b913-4d5f-a133-b37ff912942a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.240576 Aug 17 19:41:51.693050 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 204/420] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:51 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:52.720568 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1d52bf1a-6653-43ac-9b32-265a2cf6f94e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:52.722370 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1d52bf1a-6653-43ac-9b32-265a2cf6f94e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:52.731931 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1d52bf1a-6653-43ac-9b32-265a2cf6f94e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:52.732920 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1d52bf1a-6653-43ac-9b32-265a2cf6f94e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:52.733708 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1d52bf1a-6653-43ac-9b32-265a2cf6f94e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:52.734845 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1d52bf1a-6653-43ac-9b32-265a2cf6f94e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:52.735675 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1d52bf1a-6653-43ac-9b32-265a2cf6f94e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:52.736520 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1d52bf1a-6653-43ac-9b32-265a2cf6f94e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:52.770038 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:41:52.976327 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1d52bf1a-6653-43ac-9b32-265a2cf6f94e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:52.987617 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1d52bf1a-6653-43ac-9b32-265a2cf6f94e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:52.990615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1d52bf1a-6653-43ac-9b32-265a2cf6f94e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:52.992635 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1d52bf1a-6653-43ac-9b32-265a2cf6f94e tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.277083 Aug 17 19:41:52.993806 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 217/421] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:52 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:54.027080 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-9f0bb7a3-a567-46b7-a9f2-204029902b37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:54.028839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9f0bb7a3-a567-46b7-a9f2-204029902b37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:54.043844 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9f0bb7a3-a567-46b7-a9f2-204029902b37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:54.045685 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9f0bb7a3-a567-46b7-a9f2-204029902b37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:54.046515 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9f0bb7a3-a567-46b7-a9f2-204029902b37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:54.049414 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9f0bb7a3-a567-46b7-a9f2-204029902b37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:54.051709 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9f0bb7a3-a567-46b7-a9f2-204029902b37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:54.052827 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9f0bb7a3-a567-46b7-a9f2-204029902b37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:54.654306 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9f0bb7a3-a567-46b7-a9f2-204029902b37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:54.669676 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9f0bb7a3-a567-46b7-a9f2-204029902b37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:54.674986 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9f0bb7a3-a567-46b7-a9f2-204029902b37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:54.678169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-9f0bb7a3-a567-46b7-a9f2-204029902b37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.658195 Aug 17 19:41:54.681683 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 205/422] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:54 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:55.710351 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a3ffa972-c0d3-4039-9834-f7713003fb14 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:55.720662 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a3ffa972-c0d3-4039-9834-f7713003fb14 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:55.739622 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a3ffa972-c0d3-4039-9834-f7713003fb14 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:55.740452 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a3ffa972-c0d3-4039-9834-f7713003fb14 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:55.741087 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a3ffa972-c0d3-4039-9834-f7713003fb14 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:55.742014 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a3ffa972-c0d3-4039-9834-f7713003fb14 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:55.742659 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a3ffa972-c0d3-4039-9834-f7713003fb14 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:55.743300 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a3ffa972-c0d3-4039-9834-f7713003fb14 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:56.327640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a3ffa972-c0d3-4039-9834-f7713003fb14 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:56.344752 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a3ffa972-c0d3-4039-9834-f7713003fb14 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:56.355576 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a3ffa972-c0d3-4039-9834-f7713003fb14 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:56.357091 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a3ffa972-c0d3-4039-9834-f7713003fb14 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.650642 Aug 17 19:41:56.357906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 218/423] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:55 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:57.382821 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-736aaaa3-b98b-466a-9880-c81aed65148b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:57.384097 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-736aaaa3-b98b-466a-9880-c81aed65148b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:57.395198 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-736aaaa3-b98b-466a-9880-c81aed65148b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:57.397885 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-736aaaa3-b98b-466a-9880-c81aed65148b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:57.399836 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-736aaaa3-b98b-466a-9880-c81aed65148b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:57.403134 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-736aaaa3-b98b-466a-9880-c81aed65148b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:57.404434 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-736aaaa3-b98b-466a-9880-c81aed65148b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:57.405727 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-736aaaa3-b98b-466a-9880-c81aed65148b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:57.833416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-736aaaa3-b98b-466a-9880-c81aed65148b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:57.851015 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-736aaaa3-b98b-466a-9880-c81aed65148b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:57.855176 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-736aaaa3-b98b-466a-9880-c81aed65148b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:57.859213 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-736aaaa3-b98b-466a-9880-c81aed65148b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.480649 Aug 17 19:41:57.865611 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 206/424] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:57 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:41:58.883836 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9143eafc-d339-42f2-ba63-08b719103d37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:41:58.885435 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9143eafc-d339-42f2-ba63-08b719103d37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:41:58.905102 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9143eafc-d339-42f2-ba63-08b719103d37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:58.905969 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9143eafc-d339-42f2-ba63-08b719103d37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:58.906582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9143eafc-d339-42f2-ba63-08b719103d37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:58.907619 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9143eafc-d339-42f2-ba63-08b719103d37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:41:58.908586 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9143eafc-d339-42f2-ba63-08b719103d37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:41:58.909732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9143eafc-d339-42f2-ba63-08b719103d37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:41:59.146338 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9143eafc-d339-42f2-ba63-08b719103d37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:59.160714 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9143eafc-d339-42f2-ba63-08b719103d37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:59.178520 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9143eafc-d339-42f2-ba63-08b719103d37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:41:59.180326 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9143eafc-d339-42f2-ba63-08b719103d37 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.300208 Aug 17 19:41:59.193611 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 219/425] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:41:58 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:00.274165 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b4bb99e9-12ab-4381-bf81-b1ed19d71e18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:00.274965 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b4bb99e9-12ab-4381-bf81-b1ed19d71e18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:00.310832 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b4bb99e9-12ab-4381-bf81-b1ed19d71e18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:00.311574 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b4bb99e9-12ab-4381-bf81-b1ed19d71e18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:00.312237 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b4bb99e9-12ab-4381-bf81-b1ed19d71e18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:00.313363 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b4bb99e9-12ab-4381-bf81-b1ed19d71e18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:00.314036 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b4bb99e9-12ab-4381-bf81-b1ed19d71e18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:00.314794 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b4bb99e9-12ab-4381-bf81-b1ed19d71e18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:00.630637 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b4bb99e9-12ab-4381-bf81-b1ed19d71e18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:00.644068 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b4bb99e9-12ab-4381-bf81-b1ed19d71e18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:00.647253 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b4bb99e9-12ab-4381-bf81-b1ed19d71e18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:00.648953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b4bb99e9-12ab-4381-bf81-b1ed19d71e18 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.426067 Aug 17 19:42:00.649962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 207/426] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:00 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:01.681409 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-760f6868-d6b9-4a16-80d3-79a4ccdf1753 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:01.682722 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-760f6868-d6b9-4a16-80d3-79a4ccdf1753 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:01.695530 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-760f6868-d6b9-4a16-80d3-79a4ccdf1753 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:01.697455 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-760f6868-d6b9-4a16-80d3-79a4ccdf1753 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:01.700631 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-760f6868-d6b9-4a16-80d3-79a4ccdf1753 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:01.701661 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-760f6868-d6b9-4a16-80d3-79a4ccdf1753 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:01.702347 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-760f6868-d6b9-4a16-80d3-79a4ccdf1753 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:01.703017 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-760f6868-d6b9-4a16-80d3-79a4ccdf1753 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:02.021738 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-760f6868-d6b9-4a16-80d3-79a4ccdf1753 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:02.039041 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-760f6868-d6b9-4a16-80d3-79a4ccdf1753 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:02.040571 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-760f6868-d6b9-4a16-80d3-79a4ccdf1753 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:02.042628 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-760f6868-d6b9-4a16-80d3-79a4ccdf1753 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.372578 Aug 17 19:42:02.043507 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 220/427] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:01 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:03.069574 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5d7aa9a7-7876-4326-8cac-095fa174d476 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:03.070220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5d7aa9a7-7876-4326-8cac-095fa174d476 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:03.076874 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d7aa9a7-7876-4326-8cac-095fa174d476 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:03.077432 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d7aa9a7-7876-4326-8cac-095fa174d476 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:03.078356 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d7aa9a7-7876-4326-8cac-095fa174d476 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:03.078513 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d7aa9a7-7876-4326-8cac-095fa174d476 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:03.087712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d7aa9a7-7876-4326-8cac-095fa174d476 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:03.088872 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d7aa9a7-7876-4326-8cac-095fa174d476 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:03.343881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5d7aa9a7-7876-4326-8cac-095fa174d476 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:03.361584 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5d7aa9a7-7876-4326-8cac-095fa174d476 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:03.363637 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5d7aa9a7-7876-4326-8cac-095fa174d476 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:03.365019 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5d7aa9a7-7876-4326-8cac-095fa174d476 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.299918 Aug 17 19:42:03.381692 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 208/428] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:03 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:04.388458 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-87a65a9c-aa9d-4362-9fba-45e90eb3cb71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:04.389134 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-87a65a9c-aa9d-4362-9fba-45e90eb3cb71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:04.399340 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-87a65a9c-aa9d-4362-9fba-45e90eb3cb71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:04.399836 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-87a65a9c-aa9d-4362-9fba-45e90eb3cb71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:04.402881 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-87a65a9c-aa9d-4362-9fba-45e90eb3cb71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:04.403684 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-87a65a9c-aa9d-4362-9fba-45e90eb3cb71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:04.404162 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-87a65a9c-aa9d-4362-9fba-45e90eb3cb71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:04.404608 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-87a65a9c-aa9d-4362-9fba-45e90eb3cb71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:04.806781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-87a65a9c-aa9d-4362-9fba-45e90eb3cb71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:04.819828 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-87a65a9c-aa9d-4362-9fba-45e90eb3cb71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:04.837613 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-87a65a9c-aa9d-4362-9fba-45e90eb3cb71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:04.842637 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-87a65a9c-aa9d-4362-9fba-45e90eb3cb71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.458188 Aug 17 19:42:04.853886 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 221/429] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:04 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:05.880944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-86305e68-ac6f-48bf-a4b2-226884ec4d0c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:05.882275 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-86305e68-ac6f-48bf-a4b2-226884ec4d0c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:05.908235 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-86305e68-ac6f-48bf-a4b2-226884ec4d0c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:05.908876 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-86305e68-ac6f-48bf-a4b2-226884ec4d0c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:05.909471 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-86305e68-ac6f-48bf-a4b2-226884ec4d0c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:05.910927 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-86305e68-ac6f-48bf-a4b2-226884ec4d0c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:05.911493 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-86305e68-ac6f-48bf-a4b2-226884ec4d0c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:05.912022 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-86305e68-ac6f-48bf-a4b2-226884ec4d0c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:06.100099 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-86305e68-ac6f-48bf-a4b2-226884ec4d0c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:06.110928 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-86305e68-ac6f-48bf-a4b2-226884ec4d0c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:06.112780 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-86305e68-ac6f-48bf-a4b2-226884ec4d0c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:06.114345 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-86305e68-ac6f-48bf-a4b2-226884ec4d0c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.241772 Aug 17 19:42:06.115267 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 209/430] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:05 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:07.141248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-023b93de-4049-4b4b-9626-216fba743dbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:07.142126 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-023b93de-4049-4b4b-9626-216fba743dbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:07.162984 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-023b93de-4049-4b4b-9626-216fba743dbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:07.166470 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-023b93de-4049-4b4b-9626-216fba743dbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:07.167022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-023b93de-4049-4b4b-9626-216fba743dbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:07.169864 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-023b93de-4049-4b4b-9626-216fba743dbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:07.172324 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-023b93de-4049-4b4b-9626-216fba743dbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:07.172851 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-023b93de-4049-4b4b-9626-216fba743dbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:07.415427 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-023b93de-4049-4b4b-9626-216fba743dbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:07.433391 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-023b93de-4049-4b4b-9626-216fba743dbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:07.435155 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-023b93de-4049-4b4b-9626-216fba743dbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:07.436725 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-023b93de-4049-4b4b-9626-216fba743dbf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.302612 Aug 17 19:42:07.437658 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 222/431] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:07 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:07.545369 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4068069b-6761-4344-a21d-081f4a875b6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Action: 'create', calling method: .version_select at 0x7f368a0ebaf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1698037777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOt8cDBOWHwAU7/Wd2qsNQ287WONETCFzD5YlYOhK0qmRmO+oVLF7pcazziU5quNIXL7UabbEVLeRCOdfk2IfWktJcIRwt1pi4q0KudotP83QyHugPBTYreu9cqX7R57nQ=="}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:42:07.571578 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-4068069b-6761-4344-a21d-081f4a875b6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Getting quotas for project 7e072daa36df4ab7b836616c2b138c01. Resources: {'key_pairs'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:42:07.579015 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-4068069b-6761-4344-a21d-081f4a875b6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Getting quotas for user 3190c231aeb24ed6836d8fb61af24fc8 and project 7e072daa36df4ab7b836616c2b138c01. Resources: {'key_pairs'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:42:07.611174 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4068069b-6761-4344-a21d-081f4a875b6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.326267 Aug 17 19:42:07.617723 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 210/432] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 17 19:42:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:42:08.460162 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-898aa6a7-55ae-4b3b-bee7-49ec196749e9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:08.460839 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-898aa6a7-55ae-4b3b-bee7-49ec196749e9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:08.482945 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-898aa6a7-55ae-4b3b-bee7-49ec196749e9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:08.483637 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-898aa6a7-55ae-4b3b-bee7-49ec196749e9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:08.489472 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-898aa6a7-55ae-4b3b-bee7-49ec196749e9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:08.490603 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-898aa6a7-55ae-4b3b-bee7-49ec196749e9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:08.491243 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-898aa6a7-55ae-4b3b-bee7-49ec196749e9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:08.491864 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-898aa6a7-55ae-4b3b-bee7-49ec196749e9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:08.684280 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-898aa6a7-55ae-4b3b-bee7-49ec196749e9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:08.696331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-898aa6a7-55ae-4b3b-bee7-49ec196749e9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:08.697879 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-898aa6a7-55ae-4b3b-bee7-49ec196749e9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:08.699287 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-898aa6a7-55ae-4b3b-bee7-49ec196749e9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.243184 Aug 17 19:42:08.699854 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 223/433] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:08 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:09.723469 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ab615eaf-16a3-47bc-b2e8-d7300e501c05 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:09.724719 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ab615eaf-16a3-47bc-b2e8-d7300e501c05 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:09.731611 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab615eaf-16a3-47bc-b2e8-d7300e501c05 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:09.732307 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab615eaf-16a3-47bc-b2e8-d7300e501c05 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:09.732740 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab615eaf-16a3-47bc-b2e8-d7300e501c05 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:09.733473 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab615eaf-16a3-47bc-b2e8-d7300e501c05 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:09.733929 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab615eaf-16a3-47bc-b2e8-d7300e501c05 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:09.734348 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab615eaf-16a3-47bc-b2e8-d7300e501c05 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:09.864137 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ab615eaf-16a3-47bc-b2e8-d7300e501c05 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:09.873631 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ab615eaf-16a3-47bc-b2e8-d7300e501c05 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:09.875377 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ab615eaf-16a3-47bc-b2e8-d7300e501c05 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:09.876637 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ab615eaf-16a3-47bc-b2e8-d7300e501c05 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.157972 Aug 17 19:42:09.877194 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 211/434] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:09 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:10.900992 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f278a1a9-9944-4938-a0ee-27db9efddc5b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:10.901633 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f278a1a9-9944-4938-a0ee-27db9efddc5b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:10.908220 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f278a1a9-9944-4938-a0ee-27db9efddc5b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:10.908634 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f278a1a9-9944-4938-a0ee-27db9efddc5b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:10.909072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f278a1a9-9944-4938-a0ee-27db9efddc5b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:10.909858 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f278a1a9-9944-4938-a0ee-27db9efddc5b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:10.910315 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f278a1a9-9944-4938-a0ee-27db9efddc5b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:10.910738 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f278a1a9-9944-4938-a0ee-27db9efddc5b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:11.042521 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f278a1a9-9944-4938-a0ee-27db9efddc5b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:11.050709 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f278a1a9-9944-4938-a0ee-27db9efddc5b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:11.052176 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f278a1a9-9944-4938-a0ee-27db9efddc5b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:11.053341 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f278a1a9-9944-4938-a0ee-27db9efddc5b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.156703 Aug 17 19:42:11.053893 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 224/435] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:10 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:11.930439 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8bf382a0-4dbb-47ce-a5c8-b8098c99bb44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:11.930946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-8bf382a0-4dbb-47ce-a5c8-b8098c99bb44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:11.937434 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8bf382a0-4dbb-47ce-a5c8-b8098c99bb44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:11.937916 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8bf382a0-4dbb-47ce-a5c8-b8098c99bb44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:11.938351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8bf382a0-4dbb-47ce-a5c8-b8098c99bb44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:11.939045 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8bf382a0-4dbb-47ce-a5c8-b8098c99bb44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:11.939525 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8bf382a0-4dbb-47ce-a5c8-b8098c99bb44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:11.939949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8bf382a0-4dbb-47ce-a5c8-b8098c99bb44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:12.066659 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-8bf382a0-4dbb-47ce-a5c8-b8098c99bb44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lazy-loading 'services' on Instance uuid 0602879a-bbc5-4632-8412-a72ea55b9068 {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:42:12.076191 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0b881730-7d1c-4353-80d9-980809ebca7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:12.076799 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0b881730-7d1c-4353-80d9-980809ebca7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:12.079662 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=34 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:12.084940 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0b881730-7d1c-4353-80d9-980809ebca7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:12.085449 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0b881730-7d1c-4353-80d9-980809ebca7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:12.085888 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0b881730-7d1c-4353-80d9-980809ebca7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:12.086570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0b881730-7d1c-4353-80d9-980809ebca7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:12.087020 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0b881730-7d1c-4353-80d9-980809ebca7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:12.087932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0b881730-7d1c-4353-80d9-980809ebca7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:12.184634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8bf382a0-4dbb-47ce-a5c8-b8098c99bb44 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/os-volume_attachments/273434bd-f439-45f2-a0f2-1cd4cfa2d71b" status: 202 len: 0 microversion: 2.1 time: 0.259306 Aug 17 19:42:12.185670 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 212/436] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 17 19:42:11 2022] DELETE /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/os-volume_attachments/273434bd-f439-45f2-a0f2-1cd4cfa2d71b => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:42:12.223594 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0b881730-7d1c-4353-80d9-980809ebca7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:12.233289 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0b881730-7d1c-4353-80d9-980809ebca7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:12.234913 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0b881730-7d1c-4353-80d9-980809ebca7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:12.236152 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0b881730-7d1c-4353-80d9-980809ebca7a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.164017 Aug 17 19:42:12.236717 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 225/437] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:12 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:42:13.270355 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-27582497-bfaa-453a-9499-433706dbfde0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:13.271141 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-27582497-bfaa-453a-9499-433706dbfde0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:13.281744 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-27582497-bfaa-453a-9499-433706dbfde0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:13.282230 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-27582497-bfaa-453a-9499-433706dbfde0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:13.282659 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-27582497-bfaa-453a-9499-433706dbfde0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:13.283345 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-27582497-bfaa-453a-9499-433706dbfde0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:13.283792 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-27582497-bfaa-453a-9499-433706dbfde0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:13.284209 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-27582497-bfaa-453a-9499-433706dbfde0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:13.288533 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:13.424156 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-27582497-bfaa-453a-9499-433706dbfde0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:13.432618 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-27582497-bfaa-453a-9499-433706dbfde0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:13.434158 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-27582497-bfaa-453a-9499-433706dbfde0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:13.435313 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-27582497-bfaa-453a-9499-433706dbfde0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.169201 Aug 17 19:42:13.435861 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 213/438] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:13 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:14.458647 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b5cd256f-8080-4253-b898-e7023866ec22 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:14.459462 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b5cd256f-8080-4253-b898-e7023866ec22 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:14.466316 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b5cd256f-8080-4253-b898-e7023866ec22 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:14.466801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b5cd256f-8080-4253-b898-e7023866ec22 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:14.467232 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b5cd256f-8080-4253-b898-e7023866ec22 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:14.467947 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b5cd256f-8080-4253-b898-e7023866ec22 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:14.468380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b5cd256f-8080-4253-b898-e7023866ec22 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:14.468799 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b5cd256f-8080-4253-b898-e7023866ec22 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:14.597907 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b5cd256f-8080-4253-b898-e7023866ec22 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:14.607342 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b5cd256f-8080-4253-b898-e7023866ec22 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:14.608839 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b5cd256f-8080-4253-b898-e7023866ec22 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:14.610068 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b5cd256f-8080-4253-b898-e7023866ec22 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.155675 Aug 17 19:42:14.610622 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 226/439] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:14 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:42:15.634215 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f4c23e4a-8268-4cfc-b5bb-6c1efaadb07a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:15.634896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f4c23e4a-8268-4cfc-b5bb-6c1efaadb07a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:15.642385 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f4c23e4a-8268-4cfc-b5bb-6c1efaadb07a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:15.642874 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f4c23e4a-8268-4cfc-b5bb-6c1efaadb07a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:15.643309 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f4c23e4a-8268-4cfc-b5bb-6c1efaadb07a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:15.644002 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f4c23e4a-8268-4cfc-b5bb-6c1efaadb07a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:15.644453 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f4c23e4a-8268-4cfc-b5bb-6c1efaadb07a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:15.644882 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f4c23e4a-8268-4cfc-b5bb-6c1efaadb07a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:15.774265 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f4c23e4a-8268-4cfc-b5bb-6c1efaadb07a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:15.782633 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f4c23e4a-8268-4cfc-b5bb-6c1efaadb07a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:15.784105 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f4c23e4a-8268-4cfc-b5bb-6c1efaadb07a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:15.785281 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f4c23e4a-8268-4cfc-b5bb-6c1efaadb07a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.155116 Aug 17 19:42:15.785833 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 214/440] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:15 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:16.807945 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3ff9993b-7e0a-4429-bfe5-e0b58bc2014c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:16.809205 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3ff9993b-7e0a-4429-bfe5-e0b58bc2014c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:16.815568 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3ff9993b-7e0a-4429-bfe5-e0b58bc2014c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:16.816049 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3ff9993b-7e0a-4429-bfe5-e0b58bc2014c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:16.816483 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3ff9993b-7e0a-4429-bfe5-e0b58bc2014c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:16.817166 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3ff9993b-7e0a-4429-bfe5-e0b58bc2014c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:16.817681 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3ff9993b-7e0a-4429-bfe5-e0b58bc2014c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:16.818105 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3ff9993b-7e0a-4429-bfe5-e0b58bc2014c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:16.956866 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3ff9993b-7e0a-4429-bfe5-e0b58bc2014c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:16.965201 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3ff9993b-7e0a-4429-bfe5-e0b58bc2014c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:16.966787 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3ff9993b-7e0a-4429-bfe5-e0b58bc2014c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:16.967939 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3ff9993b-7e0a-4429-bfe5-e0b58bc2014c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.163924 Aug 17 19:42:16.968493 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 227/441] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:16 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:17.538092 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-dc7e4e3b-0142-4a89-be0a-689194b85c39 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:42:17.546138 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dc7e4e3b-0142-4a89-be0a-689194b85c39 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:17.546632 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dc7e4e3b-0142-4a89-be0a-689194b85c39 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:17.547067 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dc7e4e3b-0142-4a89-be0a-689194b85c39 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:17.569232 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-dc7e4e3b-0142-4a89-be0a-689194b85c39 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Going to try to stop instance {{(pid=132530) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 19:42:17.594132 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=4 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:17.614423 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-dc7e4e3b-0142-4a89-be0a-689194b85c39 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "POST /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/action" status: 202 len: 0 microversion: 2.1 time: 0.080493 Aug 17 19:42:17.615024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 215/442] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:42:17 2022] POST /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:42:17.624549 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-91e730b9-6751-4250-82f8-fe9854b36294 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:17.625516 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-91e730b9-6751-4250-82f8-fe9854b36294 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:17.633273 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-91e730b9-6751-4250-82f8-fe9854b36294 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:17.633874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-91e730b9-6751-4250-82f8-fe9854b36294 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:17.634426 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-91e730b9-6751-4250-82f8-fe9854b36294 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:17.635184 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-91e730b9-6751-4250-82f8-fe9854b36294 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:17.635645 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-91e730b9-6751-4250-82f8-fe9854b36294 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:17.636185 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-91e730b9-6751-4250-82f8-fe9854b36294 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:17.766569 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-91e730b9-6751-4250-82f8-fe9854b36294 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:17.775279 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-91e730b9-6751-4250-82f8-fe9854b36294 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.155703 Aug 17 19:42:17.775916 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 228/443] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:17 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:17.992553 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5c7fb0a7-513b-4832-a0f9-7ce611ad324d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:17.993276 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5c7fb0a7-513b-4832-a0f9-7ce611ad324d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:17.999988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5c7fb0a7-513b-4832-a0f9-7ce611ad324d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:18.000466 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5c7fb0a7-513b-4832-a0f9-7ce611ad324d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:18.000902 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5c7fb0a7-513b-4832-a0f9-7ce611ad324d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:18.001628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5c7fb0a7-513b-4832-a0f9-7ce611ad324d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:18.002081 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5c7fb0a7-513b-4832-a0f9-7ce611ad324d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:18.002501 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5c7fb0a7-513b-4832-a0f9-7ce611ad324d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:18.350111 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5c7fb0a7-513b-4832-a0f9-7ce611ad324d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:18.359947 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5c7fb0a7-513b-4832-a0f9-7ce611ad324d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:18.361487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5c7fb0a7-513b-4832-a0f9-7ce611ad324d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:18.362688 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5c7fb0a7-513b-4832-a0f9-7ce611ad324d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.374535 Aug 17 19:42:18.363256 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 216/444] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:17 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:18.796843 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-2e5d247c-0548-4c4b-b2d1-f717ac35eb11 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:18.797486 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-2e5d247c-0548-4c4b-b2d1-f717ac35eb11 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:18.803878 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2e5d247c-0548-4c4b-b2d1-f717ac35eb11 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:18.804454 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2e5d247c-0548-4c4b-b2d1-f717ac35eb11 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:18.804895 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2e5d247c-0548-4c4b-b2d1-f717ac35eb11 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:18.805671 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2e5d247c-0548-4c4b-b2d1-f717ac35eb11 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:18.806207 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2e5d247c-0548-4c4b-b2d1-f717ac35eb11 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:18.806633 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2e5d247c-0548-4c4b-b2d1-f717ac35eb11 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:18.937963 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2e5d247c-0548-4c4b-b2d1-f717ac35eb11 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:18.945401 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-2e5d247c-0548-4c4b-b2d1-f717ac35eb11 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.152900 Aug 17 19:42:18.945972 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 229/445] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:18 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:19.386536 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-0de5ff26-1717-47a6-9f37-fb57f8ee6765 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:19.387242 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-0de5ff26-1717-47a6-9f37-fb57f8ee6765 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:19.389946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:19.395548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0de5ff26-1717-47a6-9f37-fb57f8ee6765 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:19.396033 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0de5ff26-1717-47a6-9f37-fb57f8ee6765 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:19.396467 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0de5ff26-1717-47a6-9f37-fb57f8ee6765 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:19.397162 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0de5ff26-1717-47a6-9f37-fb57f8ee6765 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:19.397665 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0de5ff26-1717-47a6-9f37-fb57f8ee6765 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:19.398088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0de5ff26-1717-47a6-9f37-fb57f8ee6765 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:19.529428 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0de5ff26-1717-47a6-9f37-fb57f8ee6765 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:19.538329 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0de5ff26-1717-47a6-9f37-fb57f8ee6765 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:19.539829 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0de5ff26-1717-47a6-9f37-fb57f8ee6765 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:19.540988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-0de5ff26-1717-47a6-9f37-fb57f8ee6765 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.158518 Aug 17 19:42:19.541582 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 217/446] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:19 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:19.968308 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-59bfeca3-bcc7-4062-8f56-6bd6d4dd96a0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:19.968856 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-59bfeca3-bcc7-4062-8f56-6bd6d4dd96a0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:19.974846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59bfeca3-bcc7-4062-8f56-6bd6d4dd96a0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:19.975328 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59bfeca3-bcc7-4062-8f56-6bd6d4dd96a0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:19.975764 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59bfeca3-bcc7-4062-8f56-6bd6d4dd96a0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:19.976454 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59bfeca3-bcc7-4062-8f56-6bd6d4dd96a0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:19.976912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59bfeca3-bcc7-4062-8f56-6bd6d4dd96a0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:19.977362 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59bfeca3-bcc7-4062-8f56-6bd6d4dd96a0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:20.109617 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-59bfeca3-bcc7-4062-8f56-6bd6d4dd96a0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:20.117112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-59bfeca3-bcc7-4062-8f56-6bd6d4dd96a0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.153512 Aug 17 19:42:20.117708 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 230/447] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:19 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:20.565138 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-0fda7fdf-6b47-43f4-a3cd-bd99ccca21ef tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:20.565806 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-0fda7fdf-6b47-43f4-a3cd-bd99ccca21ef tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:20.572971 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0fda7fdf-6b47-43f4-a3cd-bd99ccca21ef tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:20.573500 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0fda7fdf-6b47-43f4-a3cd-bd99ccca21ef tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:20.574437 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0fda7fdf-6b47-43f4-a3cd-bd99ccca21ef tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:20.575413 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0fda7fdf-6b47-43f4-a3cd-bd99ccca21ef tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:20.575873 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0fda7fdf-6b47-43f4-a3cd-bd99ccca21ef tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:20.576304 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0fda7fdf-6b47-43f4-a3cd-bd99ccca21ef tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:20.672405 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-b797840e-c7de-48c0-add0-332c26b3d595 req-32c7162c-cf0b-435f-95f6-145fed431900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04daa67-36a6-4a53-b80a-e90f77348028", "name": "network-vif-plugged", "status": "completed", "tag": "8692c85c-fc9f-49cd-bff2-6ddd975dd053"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:42:20.682231 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-b797840e-c7de-48c0-add0-332c26b3d595 req-32c7162c-cf0b-435f-95f6-145fed431900 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:20.682849 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-b797840e-c7de-48c0-add0-332c26b3d595 req-32c7162c-cf0b-435f-95f6-145fed431900 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:20.683408 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-b797840e-c7de-48c0-add0-332c26b3d595 req-32c7162c-cf0b-435f-95f6-145fed431900 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:20.696008 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-b797840e-c7de-48c0-add0-332c26b3d595 req-32c7162c-cf0b-435f-95f6-145fed431900 service nova] Creating event network-vif-plugged:8692c85c-fc9f-49cd-bff2-6ddd975dd053 for instance b04daa67-36a6-4a53-b80a-e90f77348028 on hv-cinder-85069 Aug 17 19:42:20.702157 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-b797840e-c7de-48c0-add0-332c26b3d595 req-32c7162c-cf0b-435f-95f6-145fed431900 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033437 Aug 17 19:42:20.702879 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 231/448] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:42:20.716670 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0fda7fdf-6b47-43f4-a3cd-bd99ccca21ef tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:20.726658 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0fda7fdf-6b47-43f4-a3cd-bd99ccca21ef tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:20.729078 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0fda7fdf-6b47-43f4-a3cd-bd99ccca21ef tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:20.730415 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-0fda7fdf-6b47-43f4-a3cd-bd99ccca21ef tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.170080 Aug 17 19:42:20.731211 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 218/449] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:20 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:21.139891 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b65132c2-93eb-42d7-86b3-f5892b366c06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:21.140614 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b65132c2-93eb-42d7-86b3-f5892b366c06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:21.147045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b65132c2-93eb-42d7-86b3-f5892b366c06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:21.147521 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b65132c2-93eb-42d7-86b3-f5892b366c06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:21.147952 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b65132c2-93eb-42d7-86b3-f5892b366c06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:21.148663 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b65132c2-93eb-42d7-86b3-f5892b366c06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:21.149106 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b65132c2-93eb-42d7-86b3-f5892b366c06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:21.149551 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b65132c2-93eb-42d7-86b3-f5892b366c06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:21.300777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b65132c2-93eb-42d7-86b3-f5892b366c06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:21.310564 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b65132c2-93eb-42d7-86b3-f5892b366c06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.175976 Aug 17 19:42:21.311141 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 232/450] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:21 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:21.753380 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a2d6da61-9c3c-42e0-9abf-bc1dc8fa5295 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:21.753997 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a2d6da61-9c3c-42e0-9abf-bc1dc8fa5295 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:21.760244 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a2d6da61-9c3c-42e0-9abf-bc1dc8fa5295 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:21.760729 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a2d6da61-9c3c-42e0-9abf-bc1dc8fa5295 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:21.761173 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a2d6da61-9c3c-42e0-9abf-bc1dc8fa5295 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:21.762055 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a2d6da61-9c3c-42e0-9abf-bc1dc8fa5295 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:21.762343 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a2d6da61-9c3c-42e0-9abf-bc1dc8fa5295 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:21.762932 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a2d6da61-9c3c-42e0-9abf-bc1dc8fa5295 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:21.907103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a2d6da61-9c3c-42e0-9abf-bc1dc8fa5295 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:21.915478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a2d6da61-9c3c-42e0-9abf-bc1dc8fa5295 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:21.917066 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a2d6da61-9c3c-42e0-9abf-bc1dc8fa5295 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:21.918845 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a2d6da61-9c3c-42e0-9abf-bc1dc8fa5295 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.169315 Aug 17 19:42:21.919418 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 219/451] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:21 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:22.332001 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0b0b423b-7022-425f-a868-b10716e28007 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:22.332529 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0b0b423b-7022-425f-a868-b10716e28007 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:22.338892 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0b0b423b-7022-425f-a868-b10716e28007 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:22.339339 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0b0b423b-7022-425f-a868-b10716e28007 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:22.339819 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0b0b423b-7022-425f-a868-b10716e28007 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:22.340571 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0b0b423b-7022-425f-a868-b10716e28007 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:22.341098 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0b0b423b-7022-425f-a868-b10716e28007 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:22.341593 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0b0b423b-7022-425f-a868-b10716e28007 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:22.475776 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0b0b423b-7022-425f-a868-b10716e28007 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:22.486022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0b0b423b-7022-425f-a868-b10716e28007 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.157834 Aug 17 19:42:22.486603 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 233/452] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:22 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:22.944975 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3f2e06f2-bee2-456d-a684-8df09e44443c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:22.945614 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3f2e06f2-bee2-456d-a684-8df09e44443c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:22.952186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3f2e06f2-bee2-456d-a684-8df09e44443c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:22.952665 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3f2e06f2-bee2-456d-a684-8df09e44443c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:22.953098 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3f2e06f2-bee2-456d-a684-8df09e44443c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:22.953804 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3f2e06f2-bee2-456d-a684-8df09e44443c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:22.954247 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3f2e06f2-bee2-456d-a684-8df09e44443c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:22.954663 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3f2e06f2-bee2-456d-a684-8df09e44443c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:23.090538 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3f2e06f2-bee2-456d-a684-8df09e44443c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:23.098799 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3f2e06f2-bee2-456d-a684-8df09e44443c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:23.100285 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3f2e06f2-bee2-456d-a684-8df09e44443c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:23.101458 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3f2e06f2-bee2-456d-a684-8df09e44443c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1807 microversion: 2.20 time: 0.160302 Aug 17 19:42:23.102009 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 220/453] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:22 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:23.507412 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f1638ef0-4566-49bc-b66b-7d0a895bd8d4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:23.508017 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f1638ef0-4566-49bc-b66b-7d0a895bd8d4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:23.514786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1638ef0-4566-49bc-b66b-7d0a895bd8d4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:23.515263 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1638ef0-4566-49bc-b66b-7d0a895bd8d4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:23.515687 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1638ef0-4566-49bc-b66b-7d0a895bd8d4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:23.516363 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1638ef0-4566-49bc-b66b-7d0a895bd8d4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:23.516809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1638ef0-4566-49bc-b66b-7d0a895bd8d4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:23.517238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1638ef0-4566-49bc-b66b-7d0a895bd8d4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:23.519862 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=97 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:23.659977 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f1638ef0-4566-49bc-b66b-7d0a895bd8d4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:23.667382 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f1638ef0-4566-49bc-b66b-7d0a895bd8d4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.163747 Aug 17 19:42:23.667982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 234/454] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:23 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:24.126708 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a136c1a3-7c49-4ce6-a6c2-9cc90000c8b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:24.128002 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a136c1a3-7c49-4ce6-a6c2-9cc90000c8b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:24.134780 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a136c1a3-7c49-4ce6-a6c2-9cc90000c8b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:24.135269 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a136c1a3-7c49-4ce6-a6c2-9cc90000c8b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:24.135706 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a136c1a3-7c49-4ce6-a6c2-9cc90000c8b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:24.137060 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a136c1a3-7c49-4ce6-a6c2-9cc90000c8b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:24.137557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a136c1a3-7c49-4ce6-a6c2-9cc90000c8b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:24.137985 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a136c1a3-7c49-4ce6-a6c2-9cc90000c8b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:24.269193 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a136c1a3-7c49-4ce6-a6c2-9cc90000c8b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:24.277461 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a136c1a3-7c49-4ce6-a6c2-9cc90000c8b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:24.278973 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a136c1a3-7c49-4ce6-a6c2-9cc90000c8b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:24.280112 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a136c1a3-7c49-4ce6-a6c2-9cc90000c8b1 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1794 microversion: 2.20 time: 0.158041 Aug 17 19:42:24.280657 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 221/455] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:42:24 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:42:24.688643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-36f2eae5-640f-46bb-8a8a-265126a4b1cc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:24.689298 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-36f2eae5-640f-46bb-8a8a-265126a4b1cc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:24.695977 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-36f2eae5-640f-46bb-8a8a-265126a4b1cc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:24.696523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-36f2eae5-640f-46bb-8a8a-265126a4b1cc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:24.696967 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-36f2eae5-640f-46bb-8a8a-265126a4b1cc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:24.697682 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-36f2eae5-640f-46bb-8a8a-265126a4b1cc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:24.698141 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-36f2eae5-640f-46bb-8a8a-265126a4b1cc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:24.698572 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-36f2eae5-640f-46bb-8a8a-265126a4b1cc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:24.845950 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-36f2eae5-640f-46bb-8a8a-265126a4b1cc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:24.853891 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-36f2eae5-640f-46bb-8a8a-265126a4b1cc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.169137 Aug 17 19:42:24.854508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 235/456] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:24 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:25.877614 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-56d499fd-1135-4f47-9b87-3cfa9ca8bd73 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:25.878152 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-56d499fd-1135-4f47-9b87-3cfa9ca8bd73 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:25.884179 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-56d499fd-1135-4f47-9b87-3cfa9ca8bd73 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:25.884660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-56d499fd-1135-4f47-9b87-3cfa9ca8bd73 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:25.885087 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-56d499fd-1135-4f47-9b87-3cfa9ca8bd73 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:25.885796 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-56d499fd-1135-4f47-9b87-3cfa9ca8bd73 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:25.886245 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-56d499fd-1135-4f47-9b87-3cfa9ca8bd73 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:25.886661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-56d499fd-1135-4f47-9b87-3cfa9ca8bd73 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:26.018758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-56d499fd-1135-4f47-9b87-3cfa9ca8bd73 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:26.026178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-56d499fd-1135-4f47-9b87-3cfa9ca8bd73 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.152421 Aug 17 19:42:26.026757 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 222/457] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:25 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:27.048278 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-55993976-d314-4b3b-b3b6-5281356e8bff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:27.049005 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-55993976-d314-4b3b-b3b6-5281356e8bff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:27.056150 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-55993976-d314-4b3b-b3b6-5281356e8bff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:27.056667 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-55993976-d314-4b3b-b3b6-5281356e8bff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:27.057171 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-55993976-d314-4b3b-b3b6-5281356e8bff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:27.057985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-55993976-d314-4b3b-b3b6-5281356e8bff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:27.058947 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-55993976-d314-4b3b-b3b6-5281356e8bff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:27.059371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-55993976-d314-4b3b-b3b6-5281356e8bff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:27.206834 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-55993976-d314-4b3b-b3b6-5281356e8bff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:27.214593 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-55993976-d314-4b3b-b3b6-5281356e8bff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.170252 Aug 17 19:42:27.215155 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 236/458] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:27 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:28.234482 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b81f48e1-9b89-44d0-bc28-4f98ce82efde tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:28.235104 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b81f48e1-9b89-44d0-bc28-4f98ce82efde tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:28.241802 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b81f48e1-9b89-44d0-bc28-4f98ce82efde tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:28.242289 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b81f48e1-9b89-44d0-bc28-4f98ce82efde tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:28.242729 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b81f48e1-9b89-44d0-bc28-4f98ce82efde tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:28.243420 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b81f48e1-9b89-44d0-bc28-4f98ce82efde tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:28.243877 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b81f48e1-9b89-44d0-bc28-4f98ce82efde tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:28.244307 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b81f48e1-9b89-44d0-bc28-4f98ce82efde tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:28.373038 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b81f48e1-9b89-44d0-bc28-4f98ce82efde tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:28.381204 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b81f48e1-9b89-44d0-bc28-4f98ce82efde tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.150635 Aug 17 19:42:28.381798 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 223/459] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:28 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:29.249414 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-302739632", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1698037777", "security_groups": [{"name": "tempest-secgroup-smoke-1110588255"}], "networks": [{"uuid": "d55abc87-1768-49b8-b1fe-e6cde3bfee67"}], "block_device_mapping_v2": [{"uuid": "e87e0be4-9adc-4cf4-b25f-918ffcd48ad4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:42:29.359659 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.network.neutron [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] validate_networks() for [('d55abc87-1768-49b8-b1fe-e6cde3bfee67', None, None, None, None, None)] {{(pid=132531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:42:29.403382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-67c8ae8a-16b2-4825-8f71-927fc2efdc27 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:29.403985 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-67c8ae8a-16b2-4825-8f71-927fc2efdc27 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:29.410220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-67c8ae8a-16b2-4825-8f71-927fc2efdc27 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:29.410697 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-67c8ae8a-16b2-4825-8f71-927fc2efdc27 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:29.411124 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-67c8ae8a-16b2-4825-8f71-927fc2efdc27 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:29.411807 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-67c8ae8a-16b2-4825-8f71-927fc2efdc27 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:29.412257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-67c8ae8a-16b2-4825-8f71-927fc2efdc27 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:29.412671 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-67c8ae8a-16b2-4825-8f71-927fc2efdc27 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:29.608121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-67c8ae8a-16b2-4825-8f71-927fc2efdc27 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:29.615517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-67c8ae8a-16b2-4825-8f71-927fc2efdc27 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.216018 Aug 17 19:42:29.616084 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 224/460] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:29 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:42:29.793462 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Flavor limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:42:29.793894 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Image limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:42:29.794376 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Flavor pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:42:29.794809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Image pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:42:29.795220 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:42:29.803947 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:29.804427 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:29.804858 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:29.805618 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:29.806073 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:29.806496 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:29.822853 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Getting quotas for project 7e072daa36df4ab7b836616c2b138c01. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:42:29.827040 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Getting quotas for user 3190c231aeb24ed6836d8fb61af24fc8 and project 7e072daa36df4ab7b836616c2b138c01. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:42:30.031502 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Going to run 1 instances... {{(pid=132531) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:42:30.033647 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e87e0be4-9adc-4cf4-b25f-918ffcd48ad4',volume_size=None,volume_type=None)] {{(pid=132531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:42:30.159756 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-268ef4f3-072b-4e3f-9cd7-8c56aa0dcc86 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.914605 Aug 17 19:42:30.160391 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 237/461] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:42:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:42:30.171707 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c96ebecc-ea41-49e1-ba7f-d8ba48083481 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:30.172322 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c96ebecc-ea41-49e1-ba7f-d8ba48083481 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:30.225561 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c96ebecc-ea41-49e1-ba7f-d8ba48083481 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:30.232451 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c96ebecc-ea41-49e1-ba7f-d8ba48083481 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1088 microversion: 2.1 time: 0.065137 Aug 17 19:42:30.233429 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 225/462] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:30 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:30.638264 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f12e5786-327e-4a98-a76f-2c8232903f05 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:30.638864 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f12e5786-327e-4a98-a76f-2c8232903f05 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:30.645366 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f12e5786-327e-4a98-a76f-2c8232903f05 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:30.645853 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f12e5786-327e-4a98-a76f-2c8232903f05 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:30.646287 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f12e5786-327e-4a98-a76f-2c8232903f05 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:30.646984 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f12e5786-327e-4a98-a76f-2c8232903f05 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:30.647439 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f12e5786-327e-4a98-a76f-2c8232903f05 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:30.647864 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f12e5786-327e-4a98-a76f-2c8232903f05 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:30.782362 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f12e5786-327e-4a98-a76f-2c8232903f05 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:30.790047 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f12e5786-327e-4a98-a76f-2c8232903f05 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.157196 Aug 17 19:42:30.790606 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 238/463] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:30 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:31.252614 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-20dbc4b5-81ef-44ca-a563-f2366e7e2c2a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:31.253302 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-20dbc4b5-81ef-44ca-a563-f2366e7e2c2a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:31.260974 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-20dbc4b5-81ef-44ca-a563-f2366e7e2c2a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:31.261499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-20dbc4b5-81ef-44ca-a563-f2366e7e2c2a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:31.261929 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-20dbc4b5-81ef-44ca-a563-f2366e7e2c2a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:31.262627 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-20dbc4b5-81ef-44ca-a563-f2366e7e2c2a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:31.263072 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-20dbc4b5-81ef-44ca-a563-f2366e7e2c2a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:31.263705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-20dbc4b5-81ef-44ca-a563-f2366e7e2c2a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:31.332553 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-20dbc4b5-81ef-44ca-a563-f2366e7e2c2a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:31.340648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-20dbc4b5-81ef-44ca-a563-f2366e7e2c2a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1194 microversion: 2.1 time: 0.092023 Aug 17 19:42:31.348561 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 226/464] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:31 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:31.810525 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-06447eef-6043-4420-9c79-8770febf11ba tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:31.811058 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-06447eef-6043-4420-9c79-8770febf11ba tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:31.817959 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-06447eef-6043-4420-9c79-8770febf11ba tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:31.818532 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-06447eef-6043-4420-9c79-8770febf11ba tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:31.819162 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-06447eef-6043-4420-9c79-8770febf11ba tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:31.819879 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-06447eef-6043-4420-9c79-8770febf11ba tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:31.821374 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-06447eef-6043-4420-9c79-8770febf11ba tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:31.821374 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-06447eef-6043-4420-9c79-8770febf11ba tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:31.982496 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-06447eef-6043-4420-9c79-8770febf11ba tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:31.991887 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-06447eef-6043-4420-9c79-8770febf11ba tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.185291 Aug 17 19:42:31.992797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 239/465] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:31 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:32.361937 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-bb103768-dce3-4be5-a49e-2ef1a9c33a6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:32.362544 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-bb103768-dce3-4be5-a49e-2ef1a9c33a6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:32.368748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb103768-dce3-4be5-a49e-2ef1a9c33a6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:32.369239 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb103768-dce3-4be5-a49e-2ef1a9c33a6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:32.369682 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb103768-dce3-4be5-a49e-2ef1a9c33a6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:32.370895 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb103768-dce3-4be5-a49e-2ef1a9c33a6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:32.371348 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb103768-dce3-4be5-a49e-2ef1a9c33a6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:32.371766 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb103768-dce3-4be5-a49e-2ef1a9c33a6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:32.507345 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-bb103768-dce3-4be5-a49e-2ef1a9c33a6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:32.515676 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-bb103768-dce3-4be5-a49e-2ef1a9c33a6a tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1260 microversion: 2.1 time: 0.157574 Aug 17 19:42:32.516232 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 227/466] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:32 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:32.619149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-fe7c6f5f-b025-4129-9bd7-131bd83abde5 req-9247ea39-705e-4f81-b398-54030f6fb970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76985445-294d-45f5-9f95-40951eed1555", "tag": "380031c9-b01e-4d04-9d20-1e65825341f8"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:42:32.630742 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-fe7c6f5f-b025-4129-9bd7-131bd83abde5 req-9247ea39-705e-4f81-b398-54030f6fb970 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:32.631217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-fe7c6f5f-b025-4129-9bd7-131bd83abde5 req-9247ea39-705e-4f81-b398-54030f6fb970 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:32.631642 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-fe7c6f5f-b025-4129-9bd7-131bd83abde5 req-9247ea39-705e-4f81-b398-54030f6fb970 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:32.642463 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-fe7c6f5f-b025-4129-9bd7-131bd83abde5 req-9247ea39-705e-4f81-b398-54030f6fb970 service nova] Creating event network-changed:380031c9-b01e-4d04-9d20-1e65825341f8 for instance 76985445-294d-45f5-9f95-40951eed1555 on hv-cinder-85069 Aug 17 19:42:32.647547 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-fe7c6f5f-b025-4129-9bd7-131bd83abde5 req-9247ea39-705e-4f81-b398-54030f6fb970 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033030 Aug 17 19:42:32.648136 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 240/467] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:42:33.015106 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c5f737e9-b76f-448b-948a-49a0497bb389 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:33.015754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c5f737e9-b76f-448b-948a-49a0497bb389 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:33.021733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c5f737e9-b76f-448b-948a-49a0497bb389 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:33.022219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c5f737e9-b76f-448b-948a-49a0497bb389 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:33.022657 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c5f737e9-b76f-448b-948a-49a0497bb389 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:33.023346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c5f737e9-b76f-448b-948a-49a0497bb389 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:33.023806 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c5f737e9-b76f-448b-948a-49a0497bb389 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:33.024228 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c5f737e9-b76f-448b-948a-49a0497bb389 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:33.151172 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c5f737e9-b76f-448b-948a-49a0497bb389 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:33.159087 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c5f737e9-b76f-448b-948a-49a0497bb389 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.147822 Aug 17 19:42:33.159655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 228/468] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:33 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:33.536725 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-7ae783c7-ac88-4ea9-84ae-abf057436e69 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:33.537457 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-7ae783c7-ac88-4ea9-84ae-abf057436e69 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:33.544053 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7ae783c7-ac88-4ea9-84ae-abf057436e69 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:33.544539 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7ae783c7-ac88-4ea9-84ae-abf057436e69 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:33.544976 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7ae783c7-ac88-4ea9-84ae-abf057436e69 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:33.545712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7ae783c7-ac88-4ea9-84ae-abf057436e69 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:33.546171 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7ae783c7-ac88-4ea9-84ae-abf057436e69 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:33.546598 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7ae783c7-ac88-4ea9-84ae-abf057436e69 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:33.675807 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-7ae783c7-ac88-4ea9-84ae-abf057436e69 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:33.683801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-7ae783c7-ac88-4ea9-84ae-abf057436e69 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1260 microversion: 2.1 time: 0.151347 Aug 17 19:42:33.684375 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 241/469] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:33 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:34.180238 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-7ed9d988-ce60-4476-93db-cc14c02e7a87 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:34.180837 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-7ed9d988-ce60-4476-93db-cc14c02e7a87 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:34.187960 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7ed9d988-ce60-4476-93db-cc14c02e7a87 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:34.188446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7ed9d988-ce60-4476-93db-cc14c02e7a87 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:34.188926 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7ed9d988-ce60-4476-93db-cc14c02e7a87 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:34.189650 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7ed9d988-ce60-4476-93db-cc14c02e7a87 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:34.190110 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7ed9d988-ce60-4476-93db-cc14c02e7a87 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:34.190537 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7ed9d988-ce60-4476-93db-cc14c02e7a87 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:34.321021 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-7ed9d988-ce60-4476-93db-cc14c02e7a87 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:34.323318 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:34.330208 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-7ed9d988-ce60-4476-93db-cc14c02e7a87 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.153947 Aug 17 19:42:34.330762 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 229/470] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:34 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:34.704957 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-25033454-a2ea-4bdf-b747-a5f6b23ce20e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:34.705585 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-25033454-a2ea-4bdf-b747-a5f6b23ce20e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:34.711843 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-25033454-a2ea-4bdf-b747-a5f6b23ce20e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:34.712314 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-25033454-a2ea-4bdf-b747-a5f6b23ce20e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:34.712739 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-25033454-a2ea-4bdf-b747-a5f6b23ce20e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:34.713443 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-25033454-a2ea-4bdf-b747-a5f6b23ce20e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:34.713885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-25033454-a2ea-4bdf-b747-a5f6b23ce20e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:34.714926 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-25033454-a2ea-4bdf-b747-a5f6b23ce20e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:34.844158 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-25033454-a2ea-4bdf-b747-a5f6b23ce20e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:34.851513 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-25033454-a2ea-4bdf-b747-a5f6b23ce20e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1260 microversion: 2.1 time: 0.150364 Aug 17 19:42:34.852067 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 242/471] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:34 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:35.258505 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e63a5e6c-eb55-4464-8c78-08adc26fe437 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:42:35.261710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e63a5e6c-eb55-4464-8c78-08adc26fe437 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:35.269374 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e63a5e6c-eb55-4464-8c78-08adc26fe437 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:35.269860 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e63a5e6c-eb55-4464-8c78-08adc26fe437 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:35.270297 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e63a5e6c-eb55-4464-8c78-08adc26fe437 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:35.270986 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e63a5e6c-eb55-4464-8c78-08adc26fe437 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:35.271445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e63a5e6c-eb55-4464-8c78-08adc26fe437 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:35.271870 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e63a5e6c-eb55-4464-8c78-08adc26fe437 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:35.342379 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e63a5e6c-eb55-4464-8c78-08adc26fe437 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "POST /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/action" status: 202 len: 0 microversion: 2.1 time: 0.088220 Aug 17 19:42:35.343029 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 230/472] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:42:35 2022] POST /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:42:35.351373 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-501203aa-0083-4dcd-82c7-82d86563b8ee tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:35.352064 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-501203aa-0083-4dcd-82c7-82d86563b8ee tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:35.353660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-08041d57-6649-4b32-94d3-f45a87b1fd8f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:35.353809 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-08041d57-6649-4b32-94d3-f45a87b1fd8f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:35.358235 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-501203aa-0083-4dcd-82c7-82d86563b8ee tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:35.358679 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-501203aa-0083-4dcd-82c7-82d86563b8ee tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:35.359103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-501203aa-0083-4dcd-82c7-82d86563b8ee tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:35.359844 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-501203aa-0083-4dcd-82c7-82d86563b8ee tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:35.360247 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-501203aa-0083-4dcd-82c7-82d86563b8ee tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:35.360573 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-08041d57-6649-4b32-94d3-f45a87b1fd8f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:35.360744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-501203aa-0083-4dcd-82c7-82d86563b8ee tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:35.361052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-08041d57-6649-4b32-94d3-f45a87b1fd8f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:35.361511 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-08041d57-6649-4b32-94d3-f45a87b1fd8f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:35.362263 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-08041d57-6649-4b32-94d3-f45a87b1fd8f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:35.362721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-08041d57-6649-4b32-94d3-f45a87b1fd8f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:35.363596 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-08041d57-6649-4b32-94d3-f45a87b1fd8f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:35.569903 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-501203aa-0083-4dcd-82c7-82d86563b8ee tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:35.572947 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-08041d57-6649-4b32-94d3-f45a87b1fd8f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:35.578195 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-501203aa-0083-4dcd-82c7-82d86563b8ee tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1751 microversion: 2.1 time: 0.230831 Aug 17 19:42:35.578765 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 243/473] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:35 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1751 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:42:35.581027 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-08041d57-6649-4b32-94d3-f45a87b1fd8f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1678 microversion: 2.1 time: 0.232280 Aug 17 19:42:35.581693 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 231/474] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:35 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:42:35.870940 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-86871dae-066b-4b7c-9a6f-9237882e33f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:35.871534 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-86871dae-066b-4b7c-9a6f-9237882e33f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:35.878069 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86871dae-066b-4b7c-9a6f-9237882e33f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:35.878547 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86871dae-066b-4b7c-9a6f-9237882e33f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:35.878973 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86871dae-066b-4b7c-9a6f-9237882e33f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:35.879653 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86871dae-066b-4b7c-9a6f-9237882e33f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:35.880100 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86871dae-066b-4b7c-9a6f-9237882e33f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:35.880518 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86871dae-066b-4b7c-9a6f-9237882e33f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:36.021031 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-86871dae-066b-4b7c-9a6f-9237882e33f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:36.029033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-86871dae-066b-4b7c-9a6f-9237882e33f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1260 microversion: 2.1 time: 0.161912 Aug 17 19:42:36.029639 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 244/475] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:35 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:36.600358 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-0c6e2cab-18dd-488e-94fd-0d201ff45042 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:36.600976 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-0c6e2cab-18dd-488e-94fd-0d201ff45042 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:36.601252 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b00b621b-1be2-40e2-b945-e46ef2c984bc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:36.601894 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b00b621b-1be2-40e2-b945-e46ef2c984bc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:36.608093 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0c6e2cab-18dd-488e-94fd-0d201ff45042 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:36.608494 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b00b621b-1be2-40e2-b945-e46ef2c984bc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:36.608621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0c6e2cab-18dd-488e-94fd-0d201ff45042 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:36.609022 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0c6e2cab-18dd-488e-94fd-0d201ff45042 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:36.609123 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b00b621b-1be2-40e2-b945-e46ef2c984bc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:36.609494 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b00b621b-1be2-40e2-b945-e46ef2c984bc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:36.609736 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0c6e2cab-18dd-488e-94fd-0d201ff45042 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:36.610239 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b00b621b-1be2-40e2-b945-e46ef2c984bc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:36.610335 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0c6e2cab-18dd-488e-94fd-0d201ff45042 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:36.610665 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0c6e2cab-18dd-488e-94fd-0d201ff45042 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:36.610760 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b00b621b-1be2-40e2-b945-e46ef2c984bc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:36.611111 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b00b621b-1be2-40e2-b945-e46ef2c984bc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:36.800696 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b00b621b-1be2-40e2-b945-e46ef2c984bc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:36.808352 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b00b621b-1be2-40e2-b945-e46ef2c984bc tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1655 microversion: 2.1 time: 0.210822 Aug 17 19:42:36.808917 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 245/476] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:36 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1655 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:42:36.820335 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0c6e2cab-18dd-488e-94fd-0d201ff45042 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:36.828715 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ce03ad0e-6f4d-40ab-a898-18ad6475d0fe tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:42:36.828864 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-0c6e2cab-18dd-488e-94fd-0d201ff45042 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.232559 Aug 17 19:42:36.829480 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 232/477] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:36 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:36.834887 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ce03ad0e-6f4d-40ab-a898-18ad6475d0fe tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:36.835364 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ce03ad0e-6f4d-40ab-a898-18ad6475d0fe tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:36.835789 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ce03ad0e-6f4d-40ab-a898-18ad6475d0fe tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:36.894781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ce03ad0e-6f4d-40ab-a898-18ad6475d0fe tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Going to try to start instance {{(pid=132531) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 19:42:36.936317 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ce03ad0e-6f4d-40ab-a898-18ad6475d0fe tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "POST /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/action" status: 202 len: 0 microversion: 2.1 time: 0.111395 Aug 17 19:42:36.936919 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 246/478] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:42:36 2022] POST /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 19:42:36.945890 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-833ea254-558b-4f14-b0f7-5dacaa369652 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:36.946632 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-833ea254-558b-4f14-b0f7-5dacaa369652 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:36.953528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-833ea254-558b-4f14-b0f7-5dacaa369652 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:36.953788 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-833ea254-558b-4f14-b0f7-5dacaa369652 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:36.954307 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-833ea254-558b-4f14-b0f7-5dacaa369652 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:36.955188 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-833ea254-558b-4f14-b0f7-5dacaa369652 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:36.955913 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-833ea254-558b-4f14-b0f7-5dacaa369652 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:36.956447 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-833ea254-558b-4f14-b0f7-5dacaa369652 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:37.050206 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d11c92d4-aa85-40a4-8ad1-9a05eaf1cf5e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:37.050987 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d11c92d4-aa85-40a4-8ad1-9a05eaf1cf5e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:37.057332 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d11c92d4-aa85-40a4-8ad1-9a05eaf1cf5e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:37.057821 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d11c92d4-aa85-40a4-8ad1-9a05eaf1cf5e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:37.058368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d11c92d4-aa85-40a4-8ad1-9a05eaf1cf5e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:37.059064 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d11c92d4-aa85-40a4-8ad1-9a05eaf1cf5e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:37.059517 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d11c92d4-aa85-40a4-8ad1-9a05eaf1cf5e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:37.059941 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d11c92d4-aa85-40a4-8ad1-9a05eaf1cf5e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:37.094484 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-833ea254-558b-4f14-b0f7-5dacaa369652 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:37.102468 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-833ea254-558b-4f14-b0f7-5dacaa369652 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1664 microversion: 2.1 time: 0.160722 Aug 17 19:42:37.111966 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 233/479] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:36 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:37.195321 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d11c92d4-aa85-40a4-8ad1-9a05eaf1cf5e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:37.203575 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d11c92d4-aa85-40a4-8ad1-9a05eaf1cf5e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1260 microversion: 2.1 time: 0.157646 Aug 17 19:42:37.204152 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 247/480] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:37 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:42:37.850792 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-de82115e-bfde-487d-bd6b-588dd573fad1 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:37.851334 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-de82115e-bfde-487d-bd6b-588dd573fad1 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:37.857644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de82115e-bfde-487d-bd6b-588dd573fad1 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:37.858117 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de82115e-bfde-487d-bd6b-588dd573fad1 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:37.858551 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de82115e-bfde-487d-bd6b-588dd573fad1 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:37.859226 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de82115e-bfde-487d-bd6b-588dd573fad1 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:37.859672 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de82115e-bfde-487d-bd6b-588dd573fad1 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:37.860090 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-de82115e-bfde-487d-bd6b-588dd573fad1 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:38.004775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-de82115e-bfde-487d-bd6b-588dd573fad1 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:38.013291 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-de82115e-bfde-487d-bd6b-588dd573fad1 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.166506 Aug 17 19:42:38.013860 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 234/481] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:37 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:38.123403 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d156bd03-4545-49cf-aea1-4f5594748b6a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:38.124023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d156bd03-4545-49cf-aea1-4f5594748b6a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:38.130452 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d156bd03-4545-49cf-aea1-4f5594748b6a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:38.130933 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d156bd03-4545-49cf-aea1-4f5594748b6a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:38.131400 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d156bd03-4545-49cf-aea1-4f5594748b6a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:38.132090 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d156bd03-4545-49cf-aea1-4f5594748b6a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:38.132543 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d156bd03-4545-49cf-aea1-4f5594748b6a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:38.132966 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d156bd03-4545-49cf-aea1-4f5594748b6a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:38.223809 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5a35a7de-ed62-4eae-b424-108d4412a794 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:38.224419 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5a35a7de-ed62-4eae-b424-108d4412a794 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:38.230238 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5a35a7de-ed62-4eae-b424-108d4412a794 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:38.230710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5a35a7de-ed62-4eae-b424-108d4412a794 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:38.231135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5a35a7de-ed62-4eae-b424-108d4412a794 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:38.231816 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5a35a7de-ed62-4eae-b424-108d4412a794 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:38.232262 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5a35a7de-ed62-4eae-b424-108d4412a794 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:38.232674 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5a35a7de-ed62-4eae-b424-108d4412a794 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:38.260088 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d156bd03-4545-49cf-aea1-4f5594748b6a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:38.268384 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d156bd03-4545-49cf-aea1-4f5594748b6a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1664 microversion: 2.1 time: 0.149417 Aug 17 19:42:38.269059 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 248/482] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:38 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1664 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:38.363430 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5a35a7de-ed62-4eae-b424-108d4412a794 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:38.371409 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5a35a7de-ed62-4eae-b424-108d4412a794 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1260 microversion: 2.1 time: 0.151375 Aug 17 19:42:38.371996 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 235/483] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:38 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:42:39.034992 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-7c47be88-a494-4c2f-87a2-1bc5c66d3135 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:39.035558 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-7c47be88-a494-4c2f-87a2-1bc5c66d3135 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:39.041454 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7c47be88-a494-4c2f-87a2-1bc5c66d3135 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:39.041928 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7c47be88-a494-4c2f-87a2-1bc5c66d3135 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:39.042995 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7c47be88-a494-4c2f-87a2-1bc5c66d3135 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:39.043668 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7c47be88-a494-4c2f-87a2-1bc5c66d3135 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:39.044117 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7c47be88-a494-4c2f-87a2-1bc5c66d3135 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:39.044531 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7c47be88-a494-4c2f-87a2-1bc5c66d3135 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:39.185751 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-7c47be88-a494-4c2f-87a2-1bc5c66d3135 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:39.193813 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-7c47be88-a494-4c2f-87a2-1bc5c66d3135 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.162699 Aug 17 19:42:39.194377 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 249/484] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:39 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:39.289399 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2615c814-c0be-4b81-a36e-78e99f36a714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:39.289923 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2615c814-c0be-4b81-a36e-78e99f36a714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:39.296210 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2615c814-c0be-4b81-a36e-78e99f36a714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:39.296685 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2615c814-c0be-4b81-a36e-78e99f36a714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:39.297113 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2615c814-c0be-4b81-a36e-78e99f36a714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:39.297811 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2615c814-c0be-4b81-a36e-78e99f36a714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:39.298260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2615c814-c0be-4b81-a36e-78e99f36a714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:39.298675 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2615c814-c0be-4b81-a36e-78e99f36a714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:39.392039 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6155ef9d-6d14-43f0-a8f1-1ed09629e7c7 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:39.392688 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6155ef9d-6d14-43f0-a8f1-1ed09629e7c7 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:39.398463 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6155ef9d-6d14-43f0-a8f1-1ed09629e7c7 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:39.398929 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6155ef9d-6d14-43f0-a8f1-1ed09629e7c7 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:39.399349 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6155ef9d-6d14-43f0-a8f1-1ed09629e7c7 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:39.400025 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6155ef9d-6d14-43f0-a8f1-1ed09629e7c7 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:39.400471 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6155ef9d-6d14-43f0-a8f1-1ed09629e7c7 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:39.400881 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6155ef9d-6d14-43f0-a8f1-1ed09629e7c7 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:39.429692 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-2615c814-c0be-4b81-a36e-78e99f36a714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:39.437444 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2615c814-c0be-4b81-a36e-78e99f36a714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1668 microversion: 2.1 time: 0.151934 Aug 17 19:42:39.438023 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 236/485] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:39 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:39.527842 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6155ef9d-6d14-43f0-a8f1-1ed09629e7c7 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:39.535154 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6155ef9d-6d14-43f0-a8f1-1ed09629e7c7 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1260 microversion: 2.1 time: 0.146859 Aug 17 19:42:39.535714 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 250/486] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:39 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:42:40.215841 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-22c839a9-4e33-4446-99a6-4825920df844 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:40.216374 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-22c839a9-4e33-4446-99a6-4825920df844 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:40.222213 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-22c839a9-4e33-4446-99a6-4825920df844 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:40.222685 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-22c839a9-4e33-4446-99a6-4825920df844 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:40.223109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-22c839a9-4e33-4446-99a6-4825920df844 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:40.223780 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-22c839a9-4e33-4446-99a6-4825920df844 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:40.224224 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-22c839a9-4e33-4446-99a6-4825920df844 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:40.224639 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-22c839a9-4e33-4446-99a6-4825920df844 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:40.230230 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:40.364347 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-22c839a9-4e33-4446-99a6-4825920df844 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:40.372204 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-22c839a9-4e33-4446-99a6-4825920df844 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.160252 Aug 17 19:42:40.372764 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 237/487] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:40 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:40.554933 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-55997ba0-da86-4407-bf00-c9d7aef86ad6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:40.555656 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-55997ba0-da86-4407-bf00-c9d7aef86ad6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:40.557593 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:40.558248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=6 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:40.564634 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-55997ba0-da86-4407-bf00-c9d7aef86ad6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:40.565106 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-55997ba0-da86-4407-bf00-c9d7aef86ad6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:40.565586 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-55997ba0-da86-4407-bf00-c9d7aef86ad6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:40.566256 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-55997ba0-da86-4407-bf00-c9d7aef86ad6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:40.566698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-55997ba0-da86-4407-bf00-c9d7aef86ad6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:40.567111 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-55997ba0-da86-4407-bf00-c9d7aef86ad6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:40.570933 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:40.703808 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-55997ba0-da86-4407-bf00-c9d7aef86ad6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:40.711682 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-55997ba0-da86-4407-bf00-c9d7aef86ad6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1260 microversion: 2.1 time: 0.160555 Aug 17 19:42:40.712623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 251/488] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:40 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:41.141225 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-fae282ed-03ee-4ad0-af4c-f18cb360e00b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89cc6d49-7590-4be6-92e3-c18f0d6bdce1"}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:42:41.143847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-fae282ed-03ee-4ad0-af4c-f18cb360e00b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:41.149718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fae282ed-03ee-4ad0-af4c-f18cb360e00b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:41.150208 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fae282ed-03ee-4ad0-af4c-f18cb360e00b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:41.150645 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fae282ed-03ee-4ad0-af4c-f18cb360e00b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:41.151367 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fae282ed-03ee-4ad0-af4c-f18cb360e00b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:41.151818 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fae282ed-03ee-4ad0-af4c-f18cb360e00b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:41.152242 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fae282ed-03ee-4ad0-af4c-f18cb360e00b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:41.394545 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0bf3dc19-a666-4827-9a37-4502b8efd598 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:41.395327 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0bf3dc19-a666-4827-9a37-4502b8efd598 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:41.401494 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0bf3dc19-a666-4827-9a37-4502b8efd598 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:41.401971 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0bf3dc19-a666-4827-9a37-4502b8efd598 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:41.402404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0bf3dc19-a666-4827-9a37-4502b8efd598 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:41.403087 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0bf3dc19-a666-4827-9a37-4502b8efd598 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:41.403534 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0bf3dc19-a666-4827-9a37-4502b8efd598 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:41.403988 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0bf3dc19-a666-4827-9a37-4502b8efd598 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:41.527810 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-fae282ed-03ee-4ad0-af4c-f18cb360e00b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "POST /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390472 Aug 17 19:42:41.528595 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 238/489] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:42:41 2022] POST /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-volume_attachments => generated 194 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:42:41.551805 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0bf3dc19-a666-4827-9a37-4502b8efd598 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:41.561619 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0bf3dc19-a666-4827-9a37-4502b8efd598 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.171008 Aug 17 19:42:41.575649 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 252/490] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:41 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:42:41.733667 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-901d46c4-6b54-456b-83c2-4f5eb60534f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:41.734370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-901d46c4-6b54-456b-83c2-4f5eb60534f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:41.740568 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-901d46c4-6b54-456b-83c2-4f5eb60534f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:41.741060 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-901d46c4-6b54-456b-83c2-4f5eb60534f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:41.741526 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-901d46c4-6b54-456b-83c2-4f5eb60534f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:41.742225 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-901d46c4-6b54-456b-83c2-4f5eb60534f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:41.742688 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-901d46c4-6b54-456b-83c2-4f5eb60534f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:41.743114 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-901d46c4-6b54-456b-83c2-4f5eb60534f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:41.875179 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-901d46c4-6b54-456b-83c2-4f5eb60534f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:41.882592 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-901d46c4-6b54-456b-83c2-4f5eb60534f6 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1260 microversion: 2.1 time: 0.154149 Aug 17 19:42:41.883157 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 239/491] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:41 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:42.582740 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c0d0f12d-0e5a-4083-ae9c-f0a61e9f4bb3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:42.583341 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-c0d0f12d-0e5a-4083-ae9c-f0a61e9f4bb3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:42.585660 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:42.591026 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c0d0f12d-0e5a-4083-ae9c-f0a61e9f4bb3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:42.591497 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c0d0f12d-0e5a-4083-ae9c-f0a61e9f4bb3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:42.591924 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c0d0f12d-0e5a-4083-ae9c-f0a61e9f4bb3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:42.592596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c0d0f12d-0e5a-4083-ae9c-f0a61e9f4bb3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:42.593073 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c0d0f12d-0e5a-4083-ae9c-f0a61e9f4bb3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:42.593516 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c0d0f12d-0e5a-4083-ae9c-f0a61e9f4bb3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:42.740036 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-c0d0f12d-0e5a-4083-ae9c-f0a61e9f4bb3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:42.748802 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-c0d0f12d-0e5a-4083-ae9c-f0a61e9f4bb3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.169839 Aug 17 19:42:42.749400 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 253/492] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:42 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:42.779360 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-3bb99cea-0593-406e-9a6a-b5e020b925c8 req-6da62599-7833-4c9d-8a07-918b6555e5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76985445-294d-45f5-9f95-40951eed1555", "name": "network-vif-plugged", "status": "completed", "tag": "380031c9-b01e-4d04-9d20-1e65825341f8"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:42:42.789982 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-3bb99cea-0593-406e-9a6a-b5e020b925c8 req-6da62599-7833-4c9d-8a07-918b6555e5a3 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:42.790496 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-3bb99cea-0593-406e-9a6a-b5e020b925c8 req-6da62599-7833-4c9d-8a07-918b6555e5a3 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:42.791045 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-3bb99cea-0593-406e-9a6a-b5e020b925c8 req-6da62599-7833-4c9d-8a07-918b6555e5a3 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:42.802386 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-3bb99cea-0593-406e-9a6a-b5e020b925c8 req-6da62599-7833-4c9d-8a07-918b6555e5a3 service nova] Creating event network-vif-plugged:380031c9-b01e-4d04-9d20-1e65825341f8 for instance 76985445-294d-45f5-9f95-40951eed1555 on hv-cinder-85069 Aug 17 19:42:42.807012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-3bb99cea-0593-406e-9a6a-b5e020b925c8 req-6da62599-7833-4c9d-8a07-918b6555e5a3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031531 Aug 17 19:42:42.808146 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 240/493] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:42:42.903018 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b33c2eb6-e764-4d48-9d92-74f234961afd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:42.903632 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b33c2eb6-e764-4d48-9d92-74f234961afd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:42.909587 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b33c2eb6-e764-4d48-9d92-74f234961afd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:42.910069 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b33c2eb6-e764-4d48-9d92-74f234961afd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:42.910507 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b33c2eb6-e764-4d48-9d92-74f234961afd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:42.911193 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b33c2eb6-e764-4d48-9d92-74f234961afd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:42.911650 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b33c2eb6-e764-4d48-9d92-74f234961afd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:42.912077 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b33c2eb6-e764-4d48-9d92-74f234961afd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:43.047845 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b33c2eb6-e764-4d48-9d92-74f234961afd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:43.055242 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b33c2eb6-e764-4d48-9d92-74f234961afd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1260 microversion: 2.1 time: 0.156101 Aug 17 19:42:43.055811 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 254/494] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:42 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:43.771378 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-def73af4-e4c5-47c8-a6ef-7953fe42f136 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:43.772070 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-def73af4-e4c5-47c8-a6ef-7953fe42f136 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:43.778794 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-def73af4-e4c5-47c8-a6ef-7953fe42f136 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:43.779267 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-def73af4-e4c5-47c8-a6ef-7953fe42f136 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:43.779695 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-def73af4-e4c5-47c8-a6ef-7953fe42f136 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:43.780372 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-def73af4-e4c5-47c8-a6ef-7953fe42f136 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:43.780816 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-def73af4-e4c5-47c8-a6ef-7953fe42f136 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:43.781261 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-def73af4-e4c5-47c8-a6ef-7953fe42f136 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:43.922808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-def73af4-e4c5-47c8-a6ef-7953fe42f136 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:43.930722 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-def73af4-e4c5-47c8-a6ef-7953fe42f136 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.164019 Aug 17 19:42:43.931285 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 241/495] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:43 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:44.076584 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-20ffa7d2-9549-425f-99c4-a4ee38aefa8c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:44.077189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-20ffa7d2-9549-425f-99c4-a4ee38aefa8c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:44.083491 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20ffa7d2-9549-425f-99c4-a4ee38aefa8c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:44.083970 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20ffa7d2-9549-425f-99c4-a4ee38aefa8c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:44.084400 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20ffa7d2-9549-425f-99c4-a4ee38aefa8c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:44.085077 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20ffa7d2-9549-425f-99c4-a4ee38aefa8c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:44.085566 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20ffa7d2-9549-425f-99c4-a4ee38aefa8c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:44.085990 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20ffa7d2-9549-425f-99c4-a4ee38aefa8c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:44.217582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-20ffa7d2-9549-425f-99c4-a4ee38aefa8c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:44.224963 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-20ffa7d2-9549-425f-99c4-a4ee38aefa8c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1260 microversion: 2.1 time: 0.153086 Aug 17 19:42:44.225558 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 255/496] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:44 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:44.952035 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-0990534d-fff0-4f2d-8fbf-858ba2833f4f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:44.952650 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-0990534d-fff0-4f2d-8fbf-858ba2833f4f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:44.959291 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0990534d-fff0-4f2d-8fbf-858ba2833f4f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:44.959776 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0990534d-fff0-4f2d-8fbf-858ba2833f4f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:44.960212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0990534d-fff0-4f2d-8fbf-858ba2833f4f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:44.960901 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0990534d-fff0-4f2d-8fbf-858ba2833f4f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:44.961385 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0990534d-fff0-4f2d-8fbf-858ba2833f4f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:44.961808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0990534d-fff0-4f2d-8fbf-858ba2833f4f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:45.104097 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0990534d-fff0-4f2d-8fbf-858ba2833f4f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:45.112418 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-0990534d-fff0-4f2d-8fbf-858ba2833f4f tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.164606 Aug 17 19:42:45.112980 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 242/497] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:44 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:45.245615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-061dc1ac-07f3-4fc1-a857-e2a0f2a00a5c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:45.246228 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-061dc1ac-07f3-4fc1-a857-e2a0f2a00a5c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:45.252556 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-061dc1ac-07f3-4fc1-a857-e2a0f2a00a5c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:45.253064 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-061dc1ac-07f3-4fc1-a857-e2a0f2a00a5c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:45.253548 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-061dc1ac-07f3-4fc1-a857-e2a0f2a00a5c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:45.254234 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-061dc1ac-07f3-4fc1-a857-e2a0f2a00a5c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:45.254688 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-061dc1ac-07f3-4fc1-a857-e2a0f2a00a5c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:45.255112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-061dc1ac-07f3-4fc1-a857-e2a0f2a00a5c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:45.383341 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-061dc1ac-07f3-4fc1-a857-e2a0f2a00a5c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:45.391260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-061dc1ac-07f3-4fc1-a857-e2a0f2a00a5c tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1443 microversion: 2.1 time: 0.149439 Aug 17 19:42:45.391823 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 256/498] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:45 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:45.411199 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-76b22146-89bc-4014-bdb5-19b4e756a125 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:45.411868 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-76b22146-89bc-4014-bdb5-19b4e756a125 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:45.417738 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76b22146-89bc-4014-bdb5-19b4e756a125 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:45.418211 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76b22146-89bc-4014-bdb5-19b4e756a125 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:45.418637 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76b22146-89bc-4014-bdb5-19b4e756a125 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:45.419329 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76b22146-89bc-4014-bdb5-19b4e756a125 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:45.419757 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76b22146-89bc-4014-bdb5-19b4e756a125 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:45.420170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76b22146-89bc-4014-bdb5-19b4e756a125 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:45.549846 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-76b22146-89bc-4014-bdb5-19b4e756a125 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:45.556776 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-76b22146-89bc-4014-bdb5-19b4e756a125 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1443 microversion: 2.1 time: 0.149367 Aug 17 19:42:45.557384 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 243/499] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:45 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1443 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:46.133496 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-101c89f5-213e-4f5d-b844-652e36056b29 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:46.134305 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-101c89f5-213e-4f5d-b844-652e36056b29 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:46.140191 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-101c89f5-213e-4f5d-b844-652e36056b29 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:46.140680 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-101c89f5-213e-4f5d-b844-652e36056b29 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:46.141126 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-101c89f5-213e-4f5d-b844-652e36056b29 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:46.141844 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-101c89f5-213e-4f5d-b844-652e36056b29 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:46.142299 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-101c89f5-213e-4f5d-b844-652e36056b29 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:46.142724 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-101c89f5-213e-4f5d-b844-652e36056b29 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:46.288477 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-101c89f5-213e-4f5d-b844-652e36056b29 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:46.297490 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-101c89f5-213e-4f5d-b844-652e36056b29 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.167892 Aug 17 19:42:46.298058 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 257/500] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:46 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:47.318965 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3a578785-ff3b-4e92-b582-a5743c3b124c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:47.319701 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3a578785-ff3b-4e92-b582-a5743c3b124c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:47.326287 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a578785-ff3b-4e92-b582-a5743c3b124c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:47.326759 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a578785-ff3b-4e92-b582-a5743c3b124c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:47.327204 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a578785-ff3b-4e92-b582-a5743c3b124c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:47.327865 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a578785-ff3b-4e92-b582-a5743c3b124c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:47.328317 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a578785-ff3b-4e92-b582-a5743c3b124c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:47.329058 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a578785-ff3b-4e92-b582-a5743c3b124c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:47.480220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3a578785-ff3b-4e92-b582-a5743c3b124c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:47.482991 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:47.483318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-670539a2-dcdd-4b27-8e4f-65cb3146d92c req-7c66e47a-8ffc-43a3-a990-8b21735ea3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76985445-294d-45f5-9f95-40951eed1555", "tag": "380031c9-b01e-4d04-9d20-1e65825341f8"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:42:47.491074 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3a578785-ff3b-4e92-b582-a5743c3b124c tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.175844 Aug 17 19:42:47.491746 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 244/501] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:47 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:47.501157 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-670539a2-dcdd-4b27-8e4f-65cb3146d92c req-7c66e47a-8ffc-43a3-a990-8b21735ea3d2 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:47.501157 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-670539a2-dcdd-4b27-8e4f-65cb3146d92c req-7c66e47a-8ffc-43a3-a990-8b21735ea3d2 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:47.501157 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-670539a2-dcdd-4b27-8e4f-65cb3146d92c req-7c66e47a-8ffc-43a3-a990-8b21735ea3d2 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:47.506535 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-670539a2-dcdd-4b27-8e4f-65cb3146d92c req-7c66e47a-8ffc-43a3-a990-8b21735ea3d2 service nova] Creating event network-changed:380031c9-b01e-4d04-9d20-1e65825341f8 for instance 76985445-294d-45f5-9f95-40951eed1555 on hv-cinder-85069 Aug 17 19:42:47.511457 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-670539a2-dcdd-4b27-8e4f-65cb3146d92c req-7c66e47a-8ffc-43a3-a990-8b21735ea3d2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031755 Aug 17 19:42:47.512564 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 258/502] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:42:48.512083 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8fb2c604-ec24-44fe-92b1-3450618debaf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:48.512965 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-8fb2c604-ec24-44fe-92b1-3450618debaf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:48.520670 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8fb2c604-ec24-44fe-92b1-3450618debaf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:48.521275 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8fb2c604-ec24-44fe-92b1-3450618debaf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:48.521847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8fb2c604-ec24-44fe-92b1-3450618debaf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:48.522659 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8fb2c604-ec24-44fe-92b1-3450618debaf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:48.523223 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8fb2c604-ec24-44fe-92b1-3450618debaf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:48.523757 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8fb2c604-ec24-44fe-92b1-3450618debaf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:48.691072 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8fb2c604-ec24-44fe-92b1-3450618debaf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:48.699151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8fb2c604-ec24-44fe-92b1-3450618debaf tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.191087 Aug 17 19:42:48.699788 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 245/503] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:48 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:49.057994 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-59d10aca-c9ba-4590-bb67-1b9bdd94d45b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:42:49.060402 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-59d10aca-c9ba-4590-bb67-1b9bdd94d45b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:49.066486 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59d10aca-c9ba-4590-bb67-1b9bdd94d45b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:49.066967 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59d10aca-c9ba-4590-bb67-1b9bdd94d45b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:49.067400 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59d10aca-c9ba-4590-bb67-1b9bdd94d45b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:49.068107 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59d10aca-c9ba-4590-bb67-1b9bdd94d45b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:49.068586 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59d10aca-c9ba-4590-bb67-1b9bdd94d45b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:49.069007 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59d10aca-c9ba-4590-bb67-1b9bdd94d45b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:49.091836 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.objects.instance [None req-59d10aca-c9ba-4590-bb67-1b9bdd94d45b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lazy-loading 'flavor' on Instance uuid be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb {{(pid=132531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:42:49.209627 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-59d10aca-c9ba-4590-bb67-1b9bdd94d45b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "POST /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/action" status: 200 len: 32 microversion: 2.1 time: 0.156287 Aug 17 19:42:49.210151 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 259/504] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:42:49 2022] POST /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 19:42:49.220478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4e183c4b-28f9-453a-8245-79cd301def2b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:49.221187 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4e183c4b-28f9-453a-8245-79cd301def2b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:49.227254 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e183c4b-28f9-453a-8245-79cd301def2b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:49.227738 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e183c4b-28f9-453a-8245-79cd301def2b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:49.228174 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e183c4b-28f9-453a-8245-79cd301def2b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:49.228879 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e183c4b-28f9-453a-8245-79cd301def2b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:49.229364 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e183c4b-28f9-453a-8245-79cd301def2b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:49.229794 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e183c4b-28f9-453a-8245-79cd301def2b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:49.357520 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-4e183c4b-28f9-453a-8245-79cd301def2b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:49.365502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4e183c4b-28f9-453a-8245-79cd301def2b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.148934 Aug 17 19:42:49.366261 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 246/505] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:49 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:42:49.722729 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-2fc161bc-0e91-4c21-952b-7d100dd08052 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:49.723428 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-2fc161bc-0e91-4c21-952b-7d100dd08052 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:49.729658 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2fc161bc-0e91-4c21-952b-7d100dd08052 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:49.730140 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2fc161bc-0e91-4c21-952b-7d100dd08052 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:49.730582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2fc161bc-0e91-4c21-952b-7d100dd08052 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:49.731266 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2fc161bc-0e91-4c21-952b-7d100dd08052 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:49.731722 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2fc161bc-0e91-4c21-952b-7d100dd08052 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:49.732146 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2fc161bc-0e91-4c21-952b-7d100dd08052 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:49.878374 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2fc161bc-0e91-4c21-952b-7d100dd08052 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:49.886451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-2fc161bc-0e91-4c21-952b-7d100dd08052 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.167940 Aug 17 19:42:49.887529 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 260/506] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:49 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:50.387334 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1fff50d5-b387-4575-aeb2-6268ab3dd996 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:50.387940 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1fff50d5-b387-4575-aeb2-6268ab3dd996 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:50.390285 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=62 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:50.395633 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1fff50d5-b387-4575-aeb2-6268ab3dd996 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:50.396107 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1fff50d5-b387-4575-aeb2-6268ab3dd996 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:50.396540 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1fff50d5-b387-4575-aeb2-6268ab3dd996 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:50.397236 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1fff50d5-b387-4575-aeb2-6268ab3dd996 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:50.397685 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1fff50d5-b387-4575-aeb2-6268ab3dd996 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:50.398100 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1fff50d5-b387-4575-aeb2-6268ab3dd996 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:50.524159 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1fff50d5-b387-4575-aeb2-6268ab3dd996 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:50.532129 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1fff50d5-b387-4575-aeb2-6268ab3dd996 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.148780 Aug 17 19:42:50.532683 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 247/507] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:50 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:50.908246 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9bb17a9d-edb6-49e0-92f0-1139d2e33382 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:50.908879 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9bb17a9d-edb6-49e0-92f0-1139d2e33382 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:50.915239 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9bb17a9d-edb6-49e0-92f0-1139d2e33382 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:50.915710 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9bb17a9d-edb6-49e0-92f0-1139d2e33382 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:50.916136 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9bb17a9d-edb6-49e0-92f0-1139d2e33382 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:50.916812 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9bb17a9d-edb6-49e0-92f0-1139d2e33382 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:50.917290 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9bb17a9d-edb6-49e0-92f0-1139d2e33382 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:50.917698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9bb17a9d-edb6-49e0-92f0-1139d2e33382 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:51.061532 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9bb17a9d-edb6-49e0-92f0-1139d2e33382 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:51.069386 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9bb17a9d-edb6-49e0-92f0-1139d2e33382 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.164994 Aug 17 19:42:51.069938 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 261/508] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:50 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:51.553706 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-91dd1b0b-c2c6-4a6a-b33a-0b766adf553b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:51.554320 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-91dd1b0b-c2c6-4a6a-b33a-0b766adf553b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:51.561804 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-91dd1b0b-c2c6-4a6a-b33a-0b766adf553b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:51.562284 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-91dd1b0b-c2c6-4a6a-b33a-0b766adf553b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:51.562744 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-91dd1b0b-c2c6-4a6a-b33a-0b766adf553b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:51.563436 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-91dd1b0b-c2c6-4a6a-b33a-0b766adf553b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:51.563889 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-91dd1b0b-c2c6-4a6a-b33a-0b766adf553b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:51.564308 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-91dd1b0b-c2c6-4a6a-b33a-0b766adf553b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:51.689876 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-91dd1b0b-c2c6-4a6a-b33a-0b766adf553b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:51.697540 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-91dd1b0b-c2c6-4a6a-b33a-0b766adf553b tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.147684 Aug 17 19:42:51.698096 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 248/509] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:51 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:52.090690 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-df3995aa-b6b3-4fa4-9154-b791351edd47 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:52.091318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-df3995aa-b6b3-4fa4-9154-b791351edd47 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:52.097797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-df3995aa-b6b3-4fa4-9154-b791351edd47 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:52.098275 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-df3995aa-b6b3-4fa4-9154-b791351edd47 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:52.098701 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-df3995aa-b6b3-4fa4-9154-b791351edd47 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:52.099380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-df3995aa-b6b3-4fa4-9154-b791351edd47 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:52.099852 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-df3995aa-b6b3-4fa4-9154-b791351edd47 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:52.100268 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-df3995aa-b6b3-4fa4-9154-b791351edd47 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:52.240432 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-df3995aa-b6b3-4fa4-9154-b791351edd47 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:52.249126 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-df3995aa-b6b3-4fa4-9154-b791351edd47 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.162328 Aug 17 19:42:52.249731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 262/510] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:52 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:52.720186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4e2a760a-cde6-41d6-907b-7b3a416ec8ca tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:52.720786 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4e2a760a-cde6-41d6-907b-7b3a416ec8ca tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:52.727166 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e2a760a-cde6-41d6-907b-7b3a416ec8ca tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:52.727642 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e2a760a-cde6-41d6-907b-7b3a416ec8ca tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:52.728075 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e2a760a-cde6-41d6-907b-7b3a416ec8ca tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:52.728757 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e2a760a-cde6-41d6-907b-7b3a416ec8ca tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:52.729231 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e2a760a-cde6-41d6-907b-7b3a416ec8ca tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:52.729654 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e2a760a-cde6-41d6-907b-7b3a416ec8ca tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:52.858243 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-4e2a760a-cde6-41d6-907b-7b3a416ec8ca tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:52.866184 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4e2a760a-cde6-41d6-907b-7b3a416ec8ca tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.149998 Aug 17 19:42:52.866757 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 249/511] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:52 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:53.269674 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d606d9f0-1185-4e97-880f-2122a9591db8 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:53.270274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d606d9f0-1185-4e97-880f-2122a9591db8 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:53.276659 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d606d9f0-1185-4e97-880f-2122a9591db8 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:53.277130 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d606d9f0-1185-4e97-880f-2122a9591db8 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:53.277602 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d606d9f0-1185-4e97-880f-2122a9591db8 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:53.278277 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d606d9f0-1185-4e97-880f-2122a9591db8 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:53.278721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d606d9f0-1185-4e97-880f-2122a9591db8 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:53.279136 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d606d9f0-1185-4e97-880f-2122a9591db8 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:53.417493 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d606d9f0-1185-4e97-880f-2122a9591db8 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:53.425838 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d606d9f0-1185-4e97-880f-2122a9591db8 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.159997 Aug 17 19:42:53.426396 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 263/512] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:53 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:53.887150 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-bee54b0b-0d10-427a-aa55-b79bd5af5604 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:53.887760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-bee54b0b-0d10-427a-aa55-b79bd5af5604 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:53.894234 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bee54b0b-0d10-427a-aa55-b79bd5af5604 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:53.894711 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bee54b0b-0d10-427a-aa55-b79bd5af5604 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:53.895144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bee54b0b-0d10-427a-aa55-b79bd5af5604 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:53.895846 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bee54b0b-0d10-427a-aa55-b79bd5af5604 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:53.896283 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bee54b0b-0d10-427a-aa55-b79bd5af5604 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:53.896709 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bee54b0b-0d10-427a-aa55-b79bd5af5604 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:54.026057 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-bee54b0b-0d10-427a-aa55-b79bd5af5604 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:54.034388 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-bee54b0b-0d10-427a-aa55-b79bd5af5604 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.151130 Aug 17 19:42:54.034939 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 250/513] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:53 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:54.447391 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-65b789a8-bfad-4220-8695-a91ba785d5f4 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:54.448008 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-65b789a8-bfad-4220-8695-a91ba785d5f4 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:54.455194 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65b789a8-bfad-4220-8695-a91ba785d5f4 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:54.455674 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65b789a8-bfad-4220-8695-a91ba785d5f4 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:54.456112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65b789a8-bfad-4220-8695-a91ba785d5f4 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:54.456797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65b789a8-bfad-4220-8695-a91ba785d5f4 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:54.457268 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65b789a8-bfad-4220-8695-a91ba785d5f4 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:54.457721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-65b789a8-bfad-4220-8695-a91ba785d5f4 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:54.597605 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-65b789a8-bfad-4220-8695-a91ba785d5f4 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:54.605435 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-65b789a8-bfad-4220-8695-a91ba785d5f4 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.161911 Aug 17 19:42:54.605998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 264/514] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:54 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:55.056047 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-06eedeb1-0ed4-43ea-a0aa-c6ec7d65892c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:55.056654 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-06eedeb1-0ed4-43ea-a0aa-c6ec7d65892c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:55.063785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-06eedeb1-0ed4-43ea-a0aa-c6ec7d65892c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:55.064266 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-06eedeb1-0ed4-43ea-a0aa-c6ec7d65892c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:55.064700 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-06eedeb1-0ed4-43ea-a0aa-c6ec7d65892c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:55.065421 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-06eedeb1-0ed4-43ea-a0aa-c6ec7d65892c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:55.065877 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-06eedeb1-0ed4-43ea-a0aa-c6ec7d65892c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:55.066299 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-06eedeb1-0ed4-43ea-a0aa-c6ec7d65892c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:55.194944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-06eedeb1-0ed4-43ea-a0aa-c6ec7d65892c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:55.203287 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-06eedeb1-0ed4-43ea-a0aa-c6ec7d65892c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.151212 Aug 17 19:42:55.203884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 251/515] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:55 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:55.626135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-87f62a25-418c-4837-9b16-b904099bc084 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:55.626738 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-87f62a25-418c-4837-9b16-b904099bc084 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:55.633063 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-87f62a25-418c-4837-9b16-b904099bc084 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:55.633569 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-87f62a25-418c-4837-9b16-b904099bc084 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:55.634003 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-87f62a25-418c-4837-9b16-b904099bc084 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:55.634678 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-87f62a25-418c-4837-9b16-b904099bc084 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:55.635128 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-87f62a25-418c-4837-9b16-b904099bc084 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:55.635543 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-87f62a25-418c-4837-9b16-b904099bc084 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:55.778131 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-87f62a25-418c-4837-9b16-b904099bc084 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:55.785898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-87f62a25-418c-4837-9b16-b904099bc084 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.163631 Aug 17 19:42:55.786455 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 265/516] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:55 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:56.223829 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1c179220-3a71-400b-a172-b2c2bc590ea4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:56.224348 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1c179220-3a71-400b-a172-b2c2bc590ea4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:56.230688 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1c179220-3a71-400b-a172-b2c2bc590ea4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:56.231168 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1c179220-3a71-400b-a172-b2c2bc590ea4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:56.231603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1c179220-3a71-400b-a172-b2c2bc590ea4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:56.232284 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1c179220-3a71-400b-a172-b2c2bc590ea4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:56.232736 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1c179220-3a71-400b-a172-b2c2bc590ea4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:56.233155 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1c179220-3a71-400b-a172-b2c2bc590ea4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:56.359034 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1c179220-3a71-400b-a172-b2c2bc590ea4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:56.366842 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1c179220-3a71-400b-a172-b2c2bc590ea4 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.146934 Aug 17 19:42:56.367407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 252/517] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:56 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:56.806066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-aed4e588-c3c7-4c4f-9009-d7e9cfb3f900 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:56.806669 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-aed4e588-c3c7-4c4f-9009-d7e9cfb3f900 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:56.813090 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-aed4e588-c3c7-4c4f-9009-d7e9cfb3f900 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:56.813590 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-aed4e588-c3c7-4c4f-9009-d7e9cfb3f900 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:56.814017 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-aed4e588-c3c7-4c4f-9009-d7e9cfb3f900 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:56.814692 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-aed4e588-c3c7-4c4f-9009-d7e9cfb3f900 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:56.815135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-aed4e588-c3c7-4c4f-9009-d7e9cfb3f900 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:56.815550 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-aed4e588-c3c7-4c4f-9009-d7e9cfb3f900 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:56.830323 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:42:56.959255 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-aed4e588-c3c7-4c4f-9009-d7e9cfb3f900 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:56.967702 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-aed4e588-c3c7-4c4f-9009-d7e9cfb3f900 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1756 microversion: 2.1 time: 0.165430 Aug 17 19:42:56.968268 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 266/518] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:56 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:57.389272 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2d4dab00-c7a5-45a9-b35c-53bbdab3083e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:57.389884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2d4dab00-c7a5-45a9-b35c-53bbdab3083e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:57.397306 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d4dab00-c7a5-45a9-b35c-53bbdab3083e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:57.397797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d4dab00-c7a5-45a9-b35c-53bbdab3083e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:57.398271 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d4dab00-c7a5-45a9-b35c-53bbdab3083e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:57.398962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d4dab00-c7a5-45a9-b35c-53bbdab3083e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:57.399410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d4dab00-c7a5-45a9-b35c-53bbdab3083e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:57.399826 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2d4dab00-c7a5-45a9-b35c-53bbdab3083e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:57.526046 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-2d4dab00-c7a5-45a9-b35c-53bbdab3083e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:57.533940 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2d4dab00-c7a5-45a9-b35c-53bbdab3083e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.149060 Aug 17 19:42:57.534508 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 253/519] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:57 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:57.990227 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-fea19675-68c7-4ca7-a030-4c3488f12a7e tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:57.990839 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-fea19675-68c7-4ca7-a030-4c3488f12a7e tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:57.997893 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fea19675-68c7-4ca7-a030-4c3488f12a7e tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:57.998369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fea19675-68c7-4ca7-a030-4c3488f12a7e tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:57.998799 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fea19675-68c7-4ca7-a030-4c3488f12a7e tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:57.999480 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fea19675-68c7-4ca7-a030-4c3488f12a7e tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:57.999923 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fea19675-68c7-4ca7-a030-4c3488f12a7e tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:58.000341 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fea19675-68c7-4ca7-a030-4c3488f12a7e tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:58.144923 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-fea19675-68c7-4ca7-a030-4c3488f12a7e tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:58.152810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-fea19675-68c7-4ca7-a030-4c3488f12a7e tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1759 microversion: 2.1 time: 0.166477 Aug 17 19:42:58.153410 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 267/520] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:57 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:58.555072 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3bb00c52-1c32-44e2-8210-77da46aa0ee3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:58.555639 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3bb00c52-1c32-44e2-8210-77da46aa0ee3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:58.562027 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3bb00c52-1c32-44e2-8210-77da46aa0ee3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:58.562511 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3bb00c52-1c32-44e2-8210-77da46aa0ee3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:58.562948 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3bb00c52-1c32-44e2-8210-77da46aa0ee3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:58.563640 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3bb00c52-1c32-44e2-8210-77da46aa0ee3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:58.564095 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3bb00c52-1c32-44e2-8210-77da46aa0ee3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:58.564524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3bb00c52-1c32-44e2-8210-77da46aa0ee3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:58.691639 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3bb00c52-1c32-44e2-8210-77da46aa0ee3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:58.700511 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3bb00c52-1c32-44e2-8210-77da46aa0ee3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.149086 Aug 17 19:42:58.701078 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 254/521] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:58 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:42:59.721689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b854fbbf-29b6-483a-a83f-2f469b34bcb1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:42:59.722295 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b854fbbf-29b6-483a-a83f-2f469b34bcb1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:42:59.728681 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b854fbbf-29b6-483a-a83f-2f469b34bcb1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:59.729157 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b854fbbf-29b6-483a-a83f-2f469b34bcb1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:59.729620 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b854fbbf-29b6-483a-a83f-2f469b34bcb1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:59.730804 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b854fbbf-29b6-483a-a83f-2f469b34bcb1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:42:59.731262 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b854fbbf-29b6-483a-a83f-2f469b34bcb1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:42:59.731683 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b854fbbf-29b6-483a-a83f-2f469b34bcb1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:42:59.861256 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b854fbbf-29b6-483a-a83f-2f469b34bcb1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:42:59.869260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b854fbbf-29b6-483a-a83f-2f469b34bcb1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.151401 Aug 17 19:42:59.869828 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 268/522] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:42:59 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:00.890364 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c0af956f-77ba-48f6-9d2d-19a3d697ba52 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:00.890964 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c0af956f-77ba-48f6-9d2d-19a3d697ba52 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:00.897447 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0af956f-77ba-48f6-9d2d-19a3d697ba52 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:00.897922 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0af956f-77ba-48f6-9d2d-19a3d697ba52 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:00.898353 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0af956f-77ba-48f6-9d2d-19a3d697ba52 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:00.899029 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0af956f-77ba-48f6-9d2d-19a3d697ba52 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:00.899476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0af956f-77ba-48f6-9d2d-19a3d697ba52 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:00.899892 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0af956f-77ba-48f6-9d2d-19a3d697ba52 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:01.030997 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c0af956f-77ba-48f6-9d2d-19a3d697ba52 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:01.038795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c0af956f-77ba-48f6-9d2d-19a3d697ba52 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.152287 Aug 17 19:43:01.039361 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 255/523] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:00 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:02.060976 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0824b0d5-0c58-42db-9267-3aed8c25d465 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:02.061606 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0824b0d5-0c58-42db-9267-3aed8c25d465 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:02.068042 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0824b0d5-0c58-42db-9267-3aed8c25d465 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:02.068515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0824b0d5-0c58-42db-9267-3aed8c25d465 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:02.068945 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0824b0d5-0c58-42db-9267-3aed8c25d465 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:02.069654 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0824b0d5-0c58-42db-9267-3aed8c25d465 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:02.070099 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0824b0d5-0c58-42db-9267-3aed8c25d465 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:02.070517 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0824b0d5-0c58-42db-9267-3aed8c25d465 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:02.204532 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0824b0d5-0c58-42db-9267-3aed8c25d465 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:02.212536 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0824b0d5-0c58-42db-9267-3aed8c25d465 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.155878 Aug 17 19:43:02.213098 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 269/524] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:02 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:03.235232 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-21976bf4-9a01-4585-b5c3-10eef4c46047 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:03.235749 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-21976bf4-9a01-4585-b5c3-10eef4c46047 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:03.242154 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-21976bf4-9a01-4585-b5c3-10eef4c46047 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:03.242637 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-21976bf4-9a01-4585-b5c3-10eef4c46047 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:03.243077 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-21976bf4-9a01-4585-b5c3-10eef4c46047 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:03.243757 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-21976bf4-9a01-4585-b5c3-10eef4c46047 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:03.244205 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-21976bf4-9a01-4585-b5c3-10eef4c46047 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:03.244624 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-21976bf4-9a01-4585-b5c3-10eef4c46047 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:03.373110 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-21976bf4-9a01-4585-b5c3-10eef4c46047 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:03.380946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-21976bf4-9a01-4585-b5c3-10eef4c46047 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.149656 Aug 17 19:43:03.381546 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 256/525] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:03 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:04.401863 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e4105252-b39b-4c1f-8677-db376c205687 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:04.402468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e4105252-b39b-4c1f-8677-db376c205687 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:04.408828 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e4105252-b39b-4c1f-8677-db376c205687 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:04.409330 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e4105252-b39b-4c1f-8677-db376c205687 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:04.409763 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e4105252-b39b-4c1f-8677-db376c205687 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:04.410471 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e4105252-b39b-4c1f-8677-db376c205687 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:04.410926 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e4105252-b39b-4c1f-8677-db376c205687 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:04.411348 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e4105252-b39b-4c1f-8677-db376c205687 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:04.536198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e4105252-b39b-4c1f-8677-db376c205687 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:04.544040 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e4105252-b39b-4c1f-8677-db376c205687 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.146251 Aug 17 19:43:04.544606 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 270/526] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:04 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:05.565030 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4adf925f-2a68-4015-b3c0-b334c238ccde tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:05.565695 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4adf925f-2a68-4015-b3c0-b334c238ccde tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:05.572123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4adf925f-2a68-4015-b3c0-b334c238ccde tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:05.572611 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4adf925f-2a68-4015-b3c0-b334c238ccde tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:05.573048 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4adf925f-2a68-4015-b3c0-b334c238ccde tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:05.574277 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4adf925f-2a68-4015-b3c0-b334c238ccde tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:05.574739 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4adf925f-2a68-4015-b3c0-b334c238ccde tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:05.575417 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4adf925f-2a68-4015-b3c0-b334c238ccde tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:05.703300 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-4adf925f-2a68-4015-b3c0-b334c238ccde tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:05.711271 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4adf925f-2a68-4015-b3c0-b334c238ccde tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.150111 Aug 17 19:43:05.711846 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 257/527] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:05 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:06.733916 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3795fbb4-a89a-452a-aa4f-a4ecdf0d7153 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:06.734529 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3795fbb4-a89a-452a-aa4f-a4ecdf0d7153 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:06.740841 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3795fbb4-a89a-452a-aa4f-a4ecdf0d7153 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:06.741366 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3795fbb4-a89a-452a-aa4f-a4ecdf0d7153 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:06.741806 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3795fbb4-a89a-452a-aa4f-a4ecdf0d7153 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:06.742494 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3795fbb4-a89a-452a-aa4f-a4ecdf0d7153 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:06.742950 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3795fbb4-a89a-452a-aa4f-a4ecdf0d7153 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:06.743374 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3795fbb4-a89a-452a-aa4f-a4ecdf0d7153 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:06.871873 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3795fbb4-a89a-452a-aa4f-a4ecdf0d7153 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:06.879839 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3795fbb4-a89a-452a-aa4f-a4ecdf0d7153 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.150423 Aug 17 19:43:06.880403 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 271/528] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:06 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:07.901172 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-cc720ace-29c1-491d-a3c2-ac3afa73e37a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:07.901844 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-cc720ace-29c1-491d-a3c2-ac3afa73e37a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:07.908251 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc720ace-29c1-491d-a3c2-ac3afa73e37a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:07.908734 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc720ace-29c1-491d-a3c2-ac3afa73e37a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:07.909175 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc720ace-29c1-491d-a3c2-ac3afa73e37a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:07.909905 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc720ace-29c1-491d-a3c2-ac3afa73e37a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:07.910360 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc720ace-29c1-491d-a3c2-ac3afa73e37a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:07.910787 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc720ace-29c1-491d-a3c2-ac3afa73e37a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:08.038190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-cc720ace-29c1-491d-a3c2-ac3afa73e37a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:08.046712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-cc720ace-29c1-491d-a3c2-ac3afa73e37a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1737 microversion: 2.1 time: 0.149408 Aug 17 19:43:08.047280 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 258/529] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:07 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:09.068274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-25f3696c-3d5a-49ed-a1a5-4793192a23b2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:09.068798 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-25f3696c-3d5a-49ed-a1a5-4793192a23b2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:09.075634 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-25f3696c-3d5a-49ed-a1a5-4793192a23b2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:09.076116 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-25f3696c-3d5a-49ed-a1a5-4793192a23b2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:09.076552 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-25f3696c-3d5a-49ed-a1a5-4793192a23b2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:09.077262 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-25f3696c-3d5a-49ed-a1a5-4793192a23b2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:09.077722 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-25f3696c-3d5a-49ed-a1a5-4793192a23b2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:09.078147 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-25f3696c-3d5a-49ed-a1a5-4793192a23b2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:09.209906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-25f3696c-3d5a-49ed-a1a5-4793192a23b2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:09.217767 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-25f3696c-3d5a-49ed-a1a5-4793192a23b2 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1717 microversion: 2.1 time: 0.153409 Aug 17 19:43:09.218333 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 272/530] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:09 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:09.322497 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a8be447e-ba68-49d4-bdde-505dd0fc3f57 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:09.322978 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a8be447e-ba68-49d4-bdde-505dd0fc3f57 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:09.329512 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a8be447e-ba68-49d4-bdde-505dd0fc3f57 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:09.329994 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a8be447e-ba68-49d4-bdde-505dd0fc3f57 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:09.330426 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a8be447e-ba68-49d4-bdde-505dd0fc3f57 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:09.331112 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a8be447e-ba68-49d4-bdde-505dd0fc3f57 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:09.331566 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a8be447e-ba68-49d4-bdde-505dd0fc3f57 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:09.331987 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a8be447e-ba68-49d4-bdde-505dd0fc3f57 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:09.410186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-a8be447e-ba68-49d4-bdde-505dd0fc3f57 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] HTTP exception thrown: Cannot 'detach_volume' instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb while it is in vm_state rescued Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a8be447e-ba68-49d4-bdde-505dd0fc3f57 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Request method failure captured: Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: DELETE /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-volume_attachments/89cc6d49-7590-4be6-92e3-c18f0d6bdce1 HTTP/1.1 Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPcJwP4Aez04wsbq3OzdbRwjISIv1EoEdHV7G0Tv0BOZhNI_oAYMTTg8jUzGjV7x5yv1317qpWPwanXSDZ2HVJLkJtCsQ1rLkA0WpceWCoQN0d-VsE2IzoNSddrl80YveAfdY-iiqNNDgc8UfuxsbxO5OXL3zP9DrvJm955sOURGpQ Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: 25f3817d99d84da2b797215d23de887f Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:43:09.411760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:43:09.413416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25f3817d99d84da2b797215d23de887f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25f3817d99d84da2b797215d23de887f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25f3817d99d84da2b797215d23de887f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25f3817d99d84da2b797215d23de887f"}]}] Aug 17 19:43:09.413416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:43:09.413416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: 25f3817d99d84da2b797215d23de887f Aug 17 19:43:09.413416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:43:09.413416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-ServerRescueNegativeTestJSON-747820572-project Aug 17 19:43:09.413416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:43:09.413416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:43:09.413416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 608237a0c2704cd3bda98f3724db2528 Aug 17 19:43:09.413416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-ServerRescueNegativeTestJSON-747820572-project Aug 17 19:43:09.413416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:43:09.413416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Cannot 'detach_volume' instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb while it is in vm_state rescued Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'server_id': 'be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb', 'id': '89cc6d49-7590-4be6-92e3-c18f0d6bdce1'} Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:43:09.414185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb while it is in vm_state rescued Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb while it is in vm_state rescued Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:09.415623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a8be447e-ba68-49d4-bdde-505dd0fc3f57 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Returning 409 to user: Cannot 'detach_volume' instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb while it is in vm_state rescued {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:43:09.416753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a8be447e-ba68-49d4-bdde-505dd0fc3f57 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "DELETE /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-volume_attachments/89cc6d49-7590-4be6-92e3-c18f0d6bdce1" status: 409 len: 152 microversion: 2.1 time: 0.094651 Aug 17 19:43:09.416753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 259/531] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 17 19:43:09 2022] DELETE /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-volume_attachments/89cc6d49-7590-4be6-92e3-c18f0d6bdce1 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 19:43:09.422629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5707895b-236a-4fa9-88ee-897261c1813e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:09.423171 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5707895b-236a-4fa9-88ee-897261c1813e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:09.428958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5707895b-236a-4fa9-88ee-897261c1813e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:09.429474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5707895b-236a-4fa9-88ee-897261c1813e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:09.429910 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5707895b-236a-4fa9-88ee-897261c1813e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:09.430596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5707895b-236a-4fa9-88ee-897261c1813e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:09.431053 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5707895b-236a-4fa9-88ee-897261c1813e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:09.431479 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5707895b-236a-4fa9-88ee-897261c1813e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:09.494867 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5707895b-236a-4fa9-88ee-897261c1813e tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "POST /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/action" status: 202 len: 0 microversion: 2.1 time: 0.076436 Aug 17 19:43:09.495765 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 273/532] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:43:09 2022] POST /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 19:43:09.504187 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-26f1eec1-a850-4b7c-a3d7-09f615693016 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:09.504791 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-26f1eec1-a850-4b7c-a3d7-09f615693016 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:09.510994 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-26f1eec1-a850-4b7c-a3d7-09f615693016 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:09.511712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-26f1eec1-a850-4b7c-a3d7-09f615693016 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:09.512306 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-26f1eec1-a850-4b7c-a3d7-09f615693016 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:09.513101 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-26f1eec1-a850-4b7c-a3d7-09f615693016 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:09.513653 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-26f1eec1-a850-4b7c-a3d7-09f615693016 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:09.514109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-26f1eec1-a850-4b7c-a3d7-09f615693016 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:09.642763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-26f1eec1-a850-4b7c-a3d7-09f615693016 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:09.650792 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-26f1eec1-a850-4b7c-a3d7-09f615693016 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1725 microversion: 2.1 time: 0.151082 Aug 17 19:43:09.651427 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 260/533] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:09 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:10.673815 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-561e7f74-5b4e-493a-8078-5de76a6c8512 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:10.674516 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-561e7f74-5b4e-493a-8078-5de76a6c8512 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:10.680637 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-561e7f74-5b4e-493a-8078-5de76a6c8512 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:10.681123 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-561e7f74-5b4e-493a-8078-5de76a6c8512 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:10.681584 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-561e7f74-5b4e-493a-8078-5de76a6c8512 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:10.682275 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-561e7f74-5b4e-493a-8078-5de76a6c8512 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:10.682731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-561e7f74-5b4e-493a-8078-5de76a6c8512 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:10.683156 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-561e7f74-5b4e-493a-8078-5de76a6c8512 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:10.813702 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-561e7f74-5b4e-493a-8078-5de76a6c8512 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:10.821577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-561e7f74-5b4e-493a-8078-5de76a6c8512 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1725 microversion: 2.1 time: 0.152959 Aug 17 19:43:10.822143 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 274/534] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:10 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:11.842653 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-cf4fb4a1-f14b-48c4-a10a-ea7e34707ced tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:11.843175 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-cf4fb4a1-f14b-48c4-a10a-ea7e34707ced tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:11.849677 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cf4fb4a1-f14b-48c4-a10a-ea7e34707ced tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:11.850163 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cf4fb4a1-f14b-48c4-a10a-ea7e34707ced tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:11.850598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cf4fb4a1-f14b-48c4-a10a-ea7e34707ced tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:11.851282 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cf4fb4a1-f14b-48c4-a10a-ea7e34707ced tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:11.851731 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cf4fb4a1-f14b-48c4-a10a-ea7e34707ced tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:11.852157 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cf4fb4a1-f14b-48c4-a10a-ea7e34707ced tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:11.866470 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=100 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:43:11.980309 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-cf4fb4a1-f14b-48c4-a10a-ea7e34707ced tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:11.988210 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-cf4fb4a1-f14b-48c4-a10a-ea7e34707ced tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1725 microversion: 2.1 time: 0.149556 Aug 17 19:43:11.988764 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 261/535] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:11 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:12.453989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-29c7be9f-787a-4e3a-9bd7-bf3bd27ab2c3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:12.454489 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-29c7be9f-787a-4e3a-9bd7-bf3bd27ab2c3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:12.460813 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-29c7be9f-787a-4e3a-9bd7-bf3bd27ab2c3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:12.461331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-29c7be9f-787a-4e3a-9bd7-bf3bd27ab2c3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:12.461769 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-29c7be9f-787a-4e3a-9bd7-bf3bd27ab2c3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:12.462454 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-29c7be9f-787a-4e3a-9bd7-bf3bd27ab2c3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:12.462928 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-29c7be9f-787a-4e3a-9bd7-bf3bd27ab2c3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:12.463371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-29c7be9f-787a-4e3a-9bd7-bf3bd27ab2c3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:12.494354 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-29c7be9f-787a-4e3a-9bd7-bf3bd27ab2c3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/os-volume_attachments/68c27d4b-0168-4520-9622-d39f03b20cb7" status: 200 len: 194 microversion: 2.20 time: 0.044786 Aug 17 19:43:12.494916 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 275/536] 10.222.0.59 () {60 vars in 1454 bytes} [Wed Aug 17 19:43:12 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/os-volume_attachments/68c27d4b-0168-4520-9622-d39f03b20cb7 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:43:12.561075 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-dc6976e0-01d3-4249-94f8-90be554457fa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:12.561600 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-dc6976e0-01d3-4249-94f8-90be554457fa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:12.567498 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dc6976e0-01d3-4249-94f8-90be554457fa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:12.567981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dc6976e0-01d3-4249-94f8-90be554457fa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:12.568419 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dc6976e0-01d3-4249-94f8-90be554457fa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:12.569105 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dc6976e0-01d3-4249-94f8-90be554457fa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:12.569581 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dc6976e0-01d3-4249-94f8-90be554457fa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:12.570003 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dc6976e0-01d3-4249-94f8-90be554457fa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:12.649813 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-dc6976e0-01d3-4249-94f8-90be554457fa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lazy-loading 'services' on Instance uuid b04daa67-36a6-4a53-b80a-e90f77348028 {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:43:12.721363 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-dc6976e0-01d3-4249-94f8-90be554457fa tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/os-volume_attachments/68c27d4b-0168-4520-9622-d39f03b20cb7" status: 202 len: 0 microversion: 2.20 time: 0.163995 Aug 17 19:43:12.721992 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 262/537] 10.222.0.59 () {60 vars in 1457 bytes} [Wed Aug 17 19:43:12 2022] DELETE /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/os-volume_attachments/68c27d4b-0168-4520-9622-d39f03b20cb7 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:43:12.730343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-14376db7-f7aa-4782-a349-2cf93fc5a848 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:12.732677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-14376db7-f7aa-4782-a349-2cf93fc5a848 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:12.735138 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=46 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:43:12.740492 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-14376db7-f7aa-4782-a349-2cf93fc5a848 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:12.740966 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-14376db7-f7aa-4782-a349-2cf93fc5a848 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:12.741424 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-14376db7-f7aa-4782-a349-2cf93fc5a848 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:12.742110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-14376db7-f7aa-4782-a349-2cf93fc5a848 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:12.742560 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-14376db7-f7aa-4782-a349-2cf93fc5a848 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:12.742978 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-14376db7-f7aa-4782-a349-2cf93fc5a848 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:12.772152 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-14376db7-f7aa-4782-a349-2cf93fc5a848 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045668 Aug 17 19:43:12.772715 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 276/538] 10.222.0.59 () {60 vars in 1343 bytes} [Wed Aug 17 19:43:12 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 19:43:13.010868 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-037eea26-4f36-4f39-91c2-7b2dc0927b7c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:13.011494 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-037eea26-4f36-4f39-91c2-7b2dc0927b7c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:13.019706 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-037eea26-4f36-4f39-91c2-7b2dc0927b7c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:13.020383 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-037eea26-4f36-4f39-91c2-7b2dc0927b7c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:13.020819 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-037eea26-4f36-4f39-91c2-7b2dc0927b7c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:13.021530 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-037eea26-4f36-4f39-91c2-7b2dc0927b7c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:13.021986 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-037eea26-4f36-4f39-91c2-7b2dc0927b7c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:13.022408 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-037eea26-4f36-4f39-91c2-7b2dc0927b7c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:13.150544 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-037eea26-4f36-4f39-91c2-7b2dc0927b7c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:13.159137 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-037eea26-4f36-4f39-91c2-7b2dc0927b7c tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1731 microversion: 2.1 time: 0.153003 Aug 17 19:43:13.159701 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 263/539] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:13 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:13.179189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b2c3ff6b-19dd-424f-bdad-a292d5be7e62 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:13.179684 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b2c3ff6b-19dd-424f-bdad-a292d5be7e62 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:13.185544 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b2c3ff6b-19dd-424f-bdad-a292d5be7e62 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:13.186525 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b2c3ff6b-19dd-424f-bdad-a292d5be7e62 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:13.186960 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b2c3ff6b-19dd-424f-bdad-a292d5be7e62 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:13.187678 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b2c3ff6b-19dd-424f-bdad-a292d5be7e62 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:13.188135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b2c3ff6b-19dd-424f-bdad-a292d5be7e62 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:13.188561 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b2c3ff6b-19dd-424f-bdad-a292d5be7e62 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:13.263070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b2c3ff6b-19dd-424f-bdad-a292d5be7e62 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087656 Aug 17 19:43:13.263662 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 277/540] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 17 19:43:13 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:13.785114 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4352d5c4-d084-4829-85de-cd088ba09cc7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:13.787400 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4352d5c4-d084-4829-85de-cd088ba09cc7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:13.793708 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4352d5c4-d084-4829-85de-cd088ba09cc7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:13.794185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4352d5c4-d084-4829-85de-cd088ba09cc7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:13.794623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4352d5c4-d084-4829-85de-cd088ba09cc7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:13.795317 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4352d5c4-d084-4829-85de-cd088ba09cc7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:13.795777 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4352d5c4-d084-4829-85de-cd088ba09cc7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:13.796203 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4352d5c4-d084-4829-85de-cd088ba09cc7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:13.824637 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4352d5c4-d084-4829-85de-cd088ba09cc7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044030 Aug 17 19:43:13.825500 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 264/541] 10.222.0.59 () {60 vars in 1343 bytes} [Wed Aug 17 19:43:13 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:13.888085 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6bd0a108-b1f9-43ae-b655-5e59b48da847 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:13.888623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6bd0a108-b1f9-43ae-b655-5e59b48da847 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:13.895239 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6bd0a108-b1f9-43ae-b655-5e59b48da847 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:13.895713 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6bd0a108-b1f9-43ae-b655-5e59b48da847 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:13.896142 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6bd0a108-b1f9-43ae-b655-5e59b48da847 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:13.896816 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6bd0a108-b1f9-43ae-b655-5e59b48da847 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:13.897286 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6bd0a108-b1f9-43ae-b655-5e59b48da847 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:13.897709 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6bd0a108-b1f9-43ae-b655-5e59b48da847 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:13.922153 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6bd0a108-b1f9-43ae-b655-5e59b48da847 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:43:13.999074 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6bd0a108-b1f9-43ae-b655-5e59b48da847 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 204 len: 0 microversion: 2.20 time: 0.115021 Aug 17 19:43:14.000412 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 278/542] 10.222.0.59 () {60 vars in 1280 bytes} [Wed Aug 17 19:43:13 2022] DELETE /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 19:43:14.008538 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-77ae0cb4-aa3d-4398-8fbe-3f4d926e2c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:14.009162 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-77ae0cb4-aa3d-4398-8fbe-3f4d926e2c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:14.016243 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77ae0cb4-aa3d-4398-8fbe-3f4d926e2c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:14.016823 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77ae0cb4-aa3d-4398-8fbe-3f4d926e2c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:14.017165 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77ae0cb4-aa3d-4398-8fbe-3f4d926e2c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:14.017904 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77ae0cb4-aa3d-4398-8fbe-3f4d926e2c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:14.018362 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77ae0cb4-aa3d-4398-8fbe-3f4d926e2c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:14.018791 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77ae0cb4-aa3d-4398-8fbe-3f4d926e2c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:14.224228 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-77ae0cb4-aa3d-4398-8fbe-3f4d926e2c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:14.232185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-77ae0cb4-aa3d-4398-8fbe-3f4d926e2c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:14.233688 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-77ae0cb4-aa3d-4398-8fbe-3f4d926e2c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:14.234859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-77ae0cb4-aa3d-4398-8fbe-3f4d926e2c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.230215 Aug 17 19:43:14.235414 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 265/543] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:14 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:14.467161 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-00f689c5-7203-4a04-8e76-9d4084088122 req-250bc9b7-a96e-4608-9bcd-296659e48eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb", "tag": "bf5dc59e-079d-4504-b553-f9c0418123e9"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:14.476481 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-00f689c5-7203-4a04-8e76-9d4084088122 req-250bc9b7-a96e-4608-9bcd-296659e48eb5 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:14.476962 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-00f689c5-7203-4a04-8e76-9d4084088122 req-250bc9b7-a96e-4608-9bcd-296659e48eb5 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:14.477459 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-00f689c5-7203-4a04-8e76-9d4084088122 req-250bc9b7-a96e-4608-9bcd-296659e48eb5 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:14.489502 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-00f689c5-7203-4a04-8e76-9d4084088122 req-250bc9b7-a96e-4608-9bcd-296659e48eb5 service nova] Creating event network-changed:bf5dc59e-079d-4504-b553-f9c0418123e9 for instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb on hv-cinder-85069 Aug 17 19:43:14.497713 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-00f689c5-7203-4a04-8e76-9d4084088122 req-250bc9b7-a96e-4608-9bcd-296659e48eb5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034508 Aug 17 19:43:14.498318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 279/544] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:15.258499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-377f33c2-7c48-4b2b-a9d4-7bae024cab2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:15.259049 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-377f33c2-7c48-4b2b-a9d4-7bae024cab2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:15.266216 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-377f33c2-7c48-4b2b-a9d4-7bae024cab2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:15.266704 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-377f33c2-7c48-4b2b-a9d4-7bae024cab2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:15.267137 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-377f33c2-7c48-4b2b-a9d4-7bae024cab2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:15.267835 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-377f33c2-7c48-4b2b-a9d4-7bae024cab2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:15.268284 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-377f33c2-7c48-4b2b-a9d4-7bae024cab2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:15.268732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-377f33c2-7c48-4b2b-a9d4-7bae024cab2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:15.395661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-377f33c2-7c48-4b2b-a9d4-7bae024cab2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:15.403427 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-377f33c2-7c48-4b2b-a9d4-7bae024cab2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:15.404920 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-377f33c2-7c48-4b2b-a9d4-7bae024cab2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:15.406600 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-377f33c2-7c48-4b2b-a9d4-7bae024cab2f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.151603 Aug 17 19:43:15.407158 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 266/545] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:15 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:16.431362 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b03cda70-0781-499d-85a2-5f18444c6f75 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:16.431963 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b03cda70-0781-499d-85a2-5f18444c6f75 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:16.438952 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b03cda70-0781-499d-85a2-5f18444c6f75 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:16.439424 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b03cda70-0781-499d-85a2-5f18444c6f75 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:16.439847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b03cda70-0781-499d-85a2-5f18444c6f75 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:16.440525 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b03cda70-0781-499d-85a2-5f18444c6f75 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:16.440969 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b03cda70-0781-499d-85a2-5f18444c6f75 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:16.441410 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b03cda70-0781-499d-85a2-5f18444c6f75 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:16.514681 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-cb3b89f9-531c-46f9-bc0d-f8b60e1eb388 req-8d4461f7-57e6-487e-983b-acf7cdaafefc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb", "tag": "bf5dc59e-079d-4504-b553-f9c0418123e9"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:16.525863 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-cb3b89f9-531c-46f9-bc0d-f8b60e1eb388 req-8d4461f7-57e6-487e-983b-acf7cdaafefc service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:16.526344 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-cb3b89f9-531c-46f9-bc0d-f8b60e1eb388 req-8d4461f7-57e6-487e-983b-acf7cdaafefc service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:16.526776 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-cb3b89f9-531c-46f9-bc0d-f8b60e1eb388 req-8d4461f7-57e6-487e-983b-acf7cdaafefc service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:16.538958 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-cb3b89f9-531c-46f9-bc0d-f8b60e1eb388 req-8d4461f7-57e6-487e-983b-acf7cdaafefc service nova] Creating event network-changed:bf5dc59e-079d-4504-b553-f9c0418123e9 for instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb on hv-cinder-85069 Aug 17 19:43:16.543916 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-cb3b89f9-531c-46f9-bc0d-f8b60e1eb388 req-8d4461f7-57e6-487e-983b-acf7cdaafefc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032933 Aug 17 19:43:16.544507 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 267/546] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:43:16.585582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b03cda70-0781-499d-85a2-5f18444c6f75 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:16.593535 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b03cda70-0781-499d-85a2-5f18444c6f75 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:16.595018 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b03cda70-0781-499d-85a2-5f18444c6f75 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:16.596153 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b03cda70-0781-499d-85a2-5f18444c6f75 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1722 microversion: 2.20 time: 0.169198 Aug 17 19:43:16.596820 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 280/547] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:16 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:17.620932 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-7b727da8-e379-44d3-b083-5e7d87a16bc2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:17.621655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-7b727da8-e379-44d3-b083-5e7d87a16bc2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:17.628392 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7b727da8-e379-44d3-b083-5e7d87a16bc2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:17.628907 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7b727da8-e379-44d3-b083-5e7d87a16bc2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:17.629368 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7b727da8-e379-44d3-b083-5e7d87a16bc2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:17.630182 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7b727da8-e379-44d3-b083-5e7d87a16bc2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:17.630642 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7b727da8-e379-44d3-b083-5e7d87a16bc2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:17.631101 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7b727da8-e379-44d3-b083-5e7d87a16bc2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:17.695678 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-7b727da8-e379-44d3-b083-5e7d87a16bc2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:17.708629 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-7b727da8-e379-44d3-b083-5e7d87a16bc2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:17.710551 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-7b727da8-e379-44d3-b083-5e7d87a16bc2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:17.712989 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-7b727da8-e379-44d3-b083-5e7d87a16bc2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 200 len: 1654 microversion: 2.20 time: 0.096612 Aug 17 19:43:17.725741 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 268/548] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:17 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 1654 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:17.769443 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-bcdae265-0d4c-47da-9101-a7cbaa57ea64 req-90d6b9c4-8857-4f1f-9437-a0f28ad27964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b04daa67-36a6-4a53-b80a-e90f77348028", "name": "network-vif-deleted", "tag": "8692c85c-fc9f-49cd-bff2-6ddd975dd053"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:17.782723 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-bcdae265-0d4c-47da-9101-a7cbaa57ea64 req-90d6b9c4-8857-4f1f-9437-a0f28ad27964 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:17.786645 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-bcdae265-0d4c-47da-9101-a7cbaa57ea64 req-90d6b9c4-8857-4f1f-9437-a0f28ad27964 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:17.787109 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-bcdae265-0d4c-47da-9101-a7cbaa57ea64 req-90d6b9c4-8857-4f1f-9437-a0f28ad27964 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:17.806338 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-bcdae265-0d4c-47da-9101-a7cbaa57ea64 req-90d6b9c4-8857-4f1f-9437-a0f28ad27964 service nova] Creating event network-vif-deleted:8692c85c-fc9f-49cd-bff2-6ddd975dd053 for instance b04daa67-36a6-4a53-b80a-e90f77348028 on hv-cinder-85069 Aug 17 19:43:17.813079 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-bcdae265-0d4c-47da-9101-a7cbaa57ea64 req-90d6b9c4-8857-4f1f-9437-a0f28ad27964 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047151 Aug 17 19:43:17.815354 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 281/549] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:18.738733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-fe560155-09a2-4fce-b089-74e843c81c25 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:18.739418 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-fe560155-09a2-4fce-b089-74e843c81c25 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:18.745523 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fe560155-09a2-4fce-b089-74e843c81c25 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:18.746005 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fe560155-09a2-4fce-b089-74e843c81c25 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:18.746437 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fe560155-09a2-4fce-b089-74e843c81c25 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:18.747125 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fe560155-09a2-4fce-b089-74e843c81c25 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:18.747582 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fe560155-09a2-4fce-b089-74e843c81c25 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:18.748005 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fe560155-09a2-4fce-b089-74e843c81c25 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:18.763628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-fe560155-09a2-4fce-b089-74e843c81c25 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] HTTP exception thrown: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-fe560155-09a2-4fce-b089-74e843c81c25 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Request method failure captured: Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 HTTP/1.1 Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPfdck5vJBZ_LDqwcb_PdFyHuPLsXQceEuNWoFSZEHuREr5vi4FpE69x1wZXW5Tc0-TLNDLhhzyPQt7W77VgnSGhwGrUnU8JYl6Ebd6TR-EjsZT8reOeJaWkeaq72q12YuqfGHPFTr2ms5BjfStN2M5DtgLFZ8b9JUzSp8AX3R2s30 Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: 5e6832c3bb274bb1bdfd27ca3869f8cd Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:43:18.765797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:43:18.767405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5e6832c3bb274bb1bdfd27ca3869f8cd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}] Aug 17 19:43:18.767405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:43:18.767405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: 5e6832c3bb274bb1bdfd27ca3869f8cd Aug 17 19:43:18.767405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:43:18.767405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeShelveTestJSON-1724157338-project Aug 17 19:43:18.767405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:43:18.767405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:43:18.767405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: a569e6174a7c4a1887bd292e3c06df89 Aug 17 19:43:18.767405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1724157338-project Aug 17 19:43:18.767405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:43:18.767405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:43:18.767405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': 'b04daa67-36a6-4a53-b80a-e90f77348028'} Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:43:18.768220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:43:18.769478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:18.770564 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-fe560155-09a2-4fce-b089-74e843c81c25 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Returning 404 to user: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:43:18.770564 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-fe560155-09a2-4fce-b089-74e843c81c25 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 404 len: 111 microversion: 2.20 time: 0.032917 Aug 17 19:43:18.770564 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 269/550] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:18 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 19:43:18.776846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-bc8115e1-4734-48a6-b3ae-448f70989cff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '.version_select at 0x7f368a08ea60>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:18.781919 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bc8115e1-4734-48a6-b3ae-448f70989cff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [490d8550-9870-4f4c-ab80-b950a57921ca] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 19:43:19.789099 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO oslo.messaging._drivers.impl_rabbit [None req-bc8115e1-4734-48a6-b3ae-448f70989cff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [490d8550-9870-4f4c-ab80-b950a57921ca] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 51972. Aug 17 19:43:19.811243 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-bc8115e1-4734-48a6-b3ae-448f70989cff tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-946537379" status: 204 len: 0 microversion: 2.20 time: 1.038754 Aug 17 19:43:19.811904 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 282/551] 10.222.0.59 () {60 vars in 1259 bytes} [Wed Aug 17 19:43:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-946537379 => generated 0 bytes in 1040 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 17 19:43:20.444730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-35147a78-5d15-4be0-a6b5-1d4fbe0cfbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Action: 'create', calling method: .version_select at 0x7f368a1a0160>, body: {"keypair": {"name": "tempest-keypair-1587301655", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2xF5AbI1D+2gctCDDdJMm57jIP4izcOA9Vpz9AYzPPu6FNXhyhZWhhRQZ1WsdxhOiIhVajcXTaA0wv+UVIo7gY8S7RW64DBqQnSIQoZCVE5VrOuyoaN2Pbw2QJYjg3rg=="}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:20.450852 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=46 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:43:20.462982 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-35147a78-5d15-4be0-a6b5-1d4fbe0cfbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Getting quotas for project 5e6832c3bb274bb1bdfd27ca3869f8cd. Resources: {'key_pairs'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:43:20.466843 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-35147a78-5d15-4be0-a6b5-1d4fbe0cfbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Getting quotas for user a569e6174a7c4a1887bd292e3c06df89 and project 5e6832c3bb274bb1bdfd27ca3869f8cd. Resources: {'key_pairs'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:43:20.488909 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-35147a78-5d15-4be0-a6b5-1d4fbe0cfbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048041 Aug 17 19:43:20.489596 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 270/552] 10.222.0.59 () {62 vars in 1200 bytes} [Wed Aug 17 19:43:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 19:43:21.749151 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2038193383", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "53e2c10b-2873-4690-b5af-dafebda8a7df"}], "security_groups": [{"name": "tempest-securitygroup--215721778"}], "key_name": "tempest-keypair-1587301655", "user_data": "}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:21.849993 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.network.neutron [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] validate_networks() for [('53e2c10b-2873-4690-b5af-dafebda8a7df', None, None, None, None, None)] {{(pid=132531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:43:22.210889 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Flavor limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:43:22.211304 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Image limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:43:22.211772 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Flavor pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:43:22.212173 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Image pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:43:22.212585 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:43:22.221174 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:22.221674 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:22.222099 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:22.222818 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:22.223260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:22.223674 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:22.230717 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:43:22.244292 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Getting quotas for project 5e6832c3bb274bb1bdfd27ca3869f8cd. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:43:22.248283 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Getting quotas for user a569e6174a7c4a1887bd292e3c06df89 and project 5e6832c3bb274bb1bdfd27ca3869f8cd. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:43:22.259405 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Going to run 1 instances... {{(pid=132531) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:43:22.261729 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:43:22.307303 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e587e2a7-5837-4e69-813a-b746a1e94500 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.562910 Aug 17 19:43:22.307951 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 283/553] 10.222.0.59 () {62 vars in 1188 bytes} [Wed Aug 17 19:43:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 19:43:22.321502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-cbeff998-e3a8-4e36-821f-1f519f0cc998 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:22.323741 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-cbeff998-e3a8-4e36-821f-1f519f0cc998 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:22.379424 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-cbeff998-e3a8-4e36-821f-1f519f0cc998 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:22.386939 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-cbeff998-e3a8-4e36-821f-1f519f0cc998 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:22.388497 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-cbeff998-e3a8-4e36-821f-1f519f0cc998 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:22.389635 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-cbeff998-e3a8-4e36-821f-1f519f0cc998 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1282 microversion: 2.20 time: 0.073923 Aug 17 19:43:22.390969 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 271/554] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:22 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:23.412626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9fc31f84-77f0-427e-8316-5687f404dc97 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:23.413290 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9fc31f84-77f0-427e-8316-5687f404dc97 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:23.419644 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fc31f84-77f0-427e-8316-5687f404dc97 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:23.420134 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fc31f84-77f0-427e-8316-5687f404dc97 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:23.420569 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fc31f84-77f0-427e-8316-5687f404dc97 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:23.421485 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fc31f84-77f0-427e-8316-5687f404dc97 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:23.422447 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fc31f84-77f0-427e-8316-5687f404dc97 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:23.422869 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fc31f84-77f0-427e-8316-5687f404dc97 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:23.483414 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9fc31f84-77f0-427e-8316-5687f404dc97 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:23.492158 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9fc31f84-77f0-427e-8316-5687f404dc97 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:23.493696 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9fc31f84-77f0-427e-8316-5687f404dc97 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:23.494804 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9fc31f84-77f0-427e-8316-5687f404dc97 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1340 microversion: 2.20 time: 0.086795 Aug 17 19:43:23.495352 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 284/555] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:23 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1340 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:24.518398 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4e88ea28-155d-4f14-96ea-8cc6dc6ab64f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:24.518971 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4e88ea28-155d-4f14-96ea-8cc6dc6ab64f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:24.525168 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e88ea28-155d-4f14-96ea-8cc6dc6ab64f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:24.525676 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e88ea28-155d-4f14-96ea-8cc6dc6ab64f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:24.526102 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e88ea28-155d-4f14-96ea-8cc6dc6ab64f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:24.526787 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e88ea28-155d-4f14-96ea-8cc6dc6ab64f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:24.527236 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e88ea28-155d-4f14-96ea-8cc6dc6ab64f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:24.527658 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e88ea28-155d-4f14-96ea-8cc6dc6ab64f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:24.661431 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-4e88ea28-155d-4f14-96ea-8cc6dc6ab64f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:24.665164 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-abecc60d-228d-4e93-9c5f-bf0bf6ff191e req-c5ca2be7-055c-4e03-a11d-ecf1ba5d9a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cba8eae-5542-4c28-b8fa-79e93d2f0959", "tag": "d7eda5e9-6550-4d73-bb9c-c6d74429a2d5"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:24.670407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-4e88ea28-155d-4f14-96ea-8cc6dc6ab64f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:24.672174 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-4e88ea28-155d-4f14-96ea-8cc6dc6ab64f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:24.673325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4e88ea28-155d-4f14-96ea-8cc6dc6ab64f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1407 microversion: 2.20 time: 0.159580 Aug 17 19:43:24.674202 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 272/556] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:24 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:24.679453 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-abecc60d-228d-4e93-9c5f-bf0bf6ff191e req-c5ca2be7-055c-4e03-a11d-ecf1ba5d9a00 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:24.680073 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-abecc60d-228d-4e93-9c5f-bf0bf6ff191e req-c5ca2be7-055c-4e03-a11d-ecf1ba5d9a00 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:24.680745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-abecc60d-228d-4e93-9c5f-bf0bf6ff191e req-c5ca2be7-055c-4e03-a11d-ecf1ba5d9a00 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:24.698316 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-abecc60d-228d-4e93-9c5f-bf0bf6ff191e req-c5ca2be7-055c-4e03-a11d-ecf1ba5d9a00 service nova] Creating event network-changed:d7eda5e9-6550-4d73-bb9c-c6d74429a2d5 for instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 on hv-cinder-85069 Aug 17 19:43:24.704030 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-abecc60d-228d-4e93-9c5f-bf0bf6ff191e req-c5ca2be7-055c-4e03-a11d-ecf1ba5d9a00 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044924 Aug 17 19:43:24.704627 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 285/557] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:25.696891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-9c37ae83-9089-4b5c-a6ad-9b80ca0a5550 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:25.697524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9c37ae83-9089-4b5c-a6ad-9b80ca0a5550 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:25.704289 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c37ae83-9089-4b5c-a6ad-9b80ca0a5550 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:25.704742 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c37ae83-9089-4b5c-a6ad-9b80ca0a5550 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:25.705171 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c37ae83-9089-4b5c-a6ad-9b80ca0a5550 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:25.705889 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c37ae83-9089-4b5c-a6ad-9b80ca0a5550 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:25.706336 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c37ae83-9089-4b5c-a6ad-9b80ca0a5550 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:25.706753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c37ae83-9089-4b5c-a6ad-9b80ca0a5550 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:25.834790 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9c37ae83-9089-4b5c-a6ad-9b80ca0a5550 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:25.842529 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9c37ae83-9089-4b5c-a6ad-9b80ca0a5550 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:25.844005 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9c37ae83-9089-4b5c-a6ad-9b80ca0a5550 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:25.845093 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-9c37ae83-9089-4b5c-a6ad-9b80ca0a5550 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1407 microversion: 2.20 time: 0.152068 Aug 17 19:43:25.845667 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 273/558] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:25 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:26.868277 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3afd327c-34b0-41bd-946d-92d3b101c086 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:26.868886 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3afd327c-34b0-41bd-946d-92d3b101c086 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:26.875004 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3afd327c-34b0-41bd-946d-92d3b101c086 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:26.875478 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3afd327c-34b0-41bd-946d-92d3b101c086 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:26.875905 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3afd327c-34b0-41bd-946d-92d3b101c086 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:26.876580 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3afd327c-34b0-41bd-946d-92d3b101c086 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:26.877029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3afd327c-34b0-41bd-946d-92d3b101c086 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:26.877468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3afd327c-34b0-41bd-946d-92d3b101c086 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:27.009508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3afd327c-34b0-41bd-946d-92d3b101c086 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:27.018327 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3afd327c-34b0-41bd-946d-92d3b101c086 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:27.020004 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3afd327c-34b0-41bd-946d-92d3b101c086 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:27.021083 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3afd327c-34b0-41bd-946d-92d3b101c086 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1407 microversion: 2.20 time: 0.157740 Aug 17 19:43:27.021697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 286/559] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:26 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:28.043911 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c6969d75-49a7-42ad-8fd3-34c1916db58d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:28.044545 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c6969d75-49a7-42ad-8fd3-34c1916db58d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:28.051534 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c6969d75-49a7-42ad-8fd3-34c1916db58d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:28.052009 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c6969d75-49a7-42ad-8fd3-34c1916db58d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:28.052443 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c6969d75-49a7-42ad-8fd3-34c1916db58d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:28.053126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c6969d75-49a7-42ad-8fd3-34c1916db58d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:28.053600 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c6969d75-49a7-42ad-8fd3-34c1916db58d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:28.054020 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c6969d75-49a7-42ad-8fd3-34c1916db58d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:28.180296 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c6969d75-49a7-42ad-8fd3-34c1916db58d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:28.188056 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c6969d75-49a7-42ad-8fd3-34c1916db58d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:28.189570 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c6969d75-49a7-42ad-8fd3-34c1916db58d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:28.190667 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c6969d75-49a7-42ad-8fd3-34c1916db58d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1407 microversion: 2.20 time: 0.150679 Aug 17 19:43:28.191214 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 274/560] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:28 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:29.212882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3957ef07-a7ac-439f-9948-640735118df8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:29.213523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3957ef07-a7ac-439f-9948-640735118df8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:29.219869 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3957ef07-a7ac-439f-9948-640735118df8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:29.220349 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3957ef07-a7ac-439f-9948-640735118df8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:29.220780 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3957ef07-a7ac-439f-9948-640735118df8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:29.221556 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3957ef07-a7ac-439f-9948-640735118df8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:29.222010 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3957ef07-a7ac-439f-9948-640735118df8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:29.222433 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3957ef07-a7ac-439f-9948-640735118df8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:29.350248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3957ef07-a7ac-439f-9948-640735118df8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:29.358144 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3957ef07-a7ac-439f-9948-640735118df8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:29.360163 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3957ef07-a7ac-439f-9948-640735118df8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:29.361285 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3957ef07-a7ac-439f-9948-640735118df8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1407 microversion: 2.20 time: 0.152961 Aug 17 19:43:29.361844 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 287/561] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:29 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:30.383870 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b0a243a1-0241-4fa9-b48f-851bb45bfb20 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:30.384485 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b0a243a1-0241-4fa9-b48f-851bb45bfb20 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:30.391579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b0a243a1-0241-4fa9-b48f-851bb45bfb20 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:30.392059 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b0a243a1-0241-4fa9-b48f-851bb45bfb20 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:30.392496 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b0a243a1-0241-4fa9-b48f-851bb45bfb20 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:30.393185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b0a243a1-0241-4fa9-b48f-851bb45bfb20 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:30.393665 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b0a243a1-0241-4fa9-b48f-851bb45bfb20 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:30.394088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b0a243a1-0241-4fa9-b48f-851bb45bfb20 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:30.523431 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b0a243a1-0241-4fa9-b48f-851bb45bfb20 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:30.531122 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b0a243a1-0241-4fa9-b48f-851bb45bfb20 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:30.532609 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b0a243a1-0241-4fa9-b48f-851bb45bfb20 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:30.533725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b0a243a1-0241-4fa9-b48f-851bb45bfb20 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1407 microversion: 2.20 time: 0.153788 Aug 17 19:43:30.534273 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 275/562] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:30 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:30.978435 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-c86c9121-3604-4a6e-8a1b-73dc658d3ca1 req-9343d285-22b1-40f4-b23d-c58089d8f1fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cba8eae-5542-4c28-b8fa-79e93d2f0959", "name": "network-vif-plugged", "status": "completed", "tag": "d7eda5e9-6550-4d73-bb9c-c6d74429a2d5"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:30.988874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-c86c9121-3604-4a6e-8a1b-73dc658d3ca1 req-9343d285-22b1-40f4-b23d-c58089d8f1fe service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:30.989382 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-c86c9121-3604-4a6e-8a1b-73dc658d3ca1 req-9343d285-22b1-40f4-b23d-c58089d8f1fe service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:30.989811 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-c86c9121-3604-4a6e-8a1b-73dc658d3ca1 req-9343d285-22b1-40f4-b23d-c58089d8f1fe service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:31.001517 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-c86c9121-3604-4a6e-8a1b-73dc658d3ca1 req-9343d285-22b1-40f4-b23d-c58089d8f1fe service nova] Creating event network-vif-plugged:d7eda5e9-6550-4d73-bb9c-c6d74429a2d5 for instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 on hv-cinder-85069 Aug 17 19:43:31.006253 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-c86c9121-3604-4a6e-8a1b-73dc658d3ca1 req-9343d285-22b1-40f4-b23d-c58089d8f1fe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031437 Aug 17 19:43:31.006840 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 288/563] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:31.559635 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ffdacb0d-c69e-43ff-b23b-856106b85c3b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:31.560173 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ffdacb0d-c69e-43ff-b23b-856106b85c3b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:31.566542 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ffdacb0d-c69e-43ff-b23b-856106b85c3b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:31.567024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ffdacb0d-c69e-43ff-b23b-856106b85c3b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:31.567462 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ffdacb0d-c69e-43ff-b23b-856106b85c3b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:31.568161 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ffdacb0d-c69e-43ff-b23b-856106b85c3b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:31.568616 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ffdacb0d-c69e-43ff-b23b-856106b85c3b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:31.569042 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ffdacb0d-c69e-43ff-b23b-856106b85c3b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:31.695530 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ffdacb0d-c69e-43ff-b23b-856106b85c3b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:31.704136 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ffdacb0d-c69e-43ff-b23b-856106b85c3b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:31.705675 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ffdacb0d-c69e-43ff-b23b-856106b85c3b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:31.706781 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ffdacb0d-c69e-43ff-b23b-856106b85c3b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1407 microversion: 2.20 time: 0.151184 Aug 17 19:43:31.707344 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 276/564] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:31 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:32.727274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:43:32.727957 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=6 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:43:32.732138 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6ef80bfd-903c-4bf2-937e-809e4987ffde tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:32.732821 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6ef80bfd-903c-4bf2-937e-809e4987ffde tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:32.740185 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ef80bfd-903c-4bf2-937e-809e4987ffde tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:32.740687 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ef80bfd-903c-4bf2-937e-809e4987ffde tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:32.741113 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ef80bfd-903c-4bf2-937e-809e4987ffde tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:32.741812 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ef80bfd-903c-4bf2-937e-809e4987ffde tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:32.742260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ef80bfd-903c-4bf2-937e-809e4987ffde tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:32.742673 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ef80bfd-903c-4bf2-937e-809e4987ffde tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:32.874853 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6ef80bfd-903c-4bf2-937e-809e4987ffde tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:32.882639 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6ef80bfd-903c-4bf2-937e-809e4987ffde tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:32.884118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6ef80bfd-903c-4bf2-937e-809e4987ffde tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:32.885199 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6ef80bfd-903c-4bf2-937e-809e4987ffde tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1407 microversion: 2.20 time: 0.159400 Aug 17 19:43:32.885774 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 289/565] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:32 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:33.907912 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-812dd617-758c-4d77-ae2d-2461401ea5cb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:33.908672 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-812dd617-758c-4d77-ae2d-2461401ea5cb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:33.910501 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=6 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:43:33.916437 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-812dd617-758c-4d77-ae2d-2461401ea5cb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:33.916947 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-812dd617-758c-4d77-ae2d-2461401ea5cb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:33.917410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-812dd617-758c-4d77-ae2d-2461401ea5cb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:33.918110 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-812dd617-758c-4d77-ae2d-2461401ea5cb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:33.918564 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-812dd617-758c-4d77-ae2d-2461401ea5cb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:33.918984 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-812dd617-758c-4d77-ae2d-2461401ea5cb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:34.048955 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-812dd617-758c-4d77-ae2d-2461401ea5cb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:34.057188 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-812dd617-758c-4d77-ae2d-2461401ea5cb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:34.058697 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-812dd617-758c-4d77-ae2d-2461401ea5cb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:34.059867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-812dd617-758c-4d77-ae2d-2461401ea5cb tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1598 microversion: 2.20 time: 0.156114 Aug 17 19:43:34.060408 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 277/566] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:43:33 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:43:34.082579 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ad8b93ee-11b9-4530-80d0-243614bd4efc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:34.083092 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ad8b93ee-11b9-4530-80d0-243614bd4efc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:34.089502 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ad8b93ee-11b9-4530-80d0-243614bd4efc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:34.089985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ad8b93ee-11b9-4530-80d0-243614bd4efc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:34.090422 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ad8b93ee-11b9-4530-80d0-243614bd4efc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:34.091239 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ad8b93ee-11b9-4530-80d0-243614bd4efc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:34.091695 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ad8b93ee-11b9-4530-80d0-243614bd4efc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:34.092119 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ad8b93ee-11b9-4530-80d0-243614bd4efc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:34.167370 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ad8b93ee-11b9-4530-80d0-243614bd4efc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088616 Aug 17 19:43:34.167989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 290/567] 10.222.0.59 () {60 vars in 1316 bytes} [Wed Aug 17 19:43:34 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:43:35.286359 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-636cfc2b-50ef-4088-8cad-c8a02834d1e4 req-c68f4d4d-8cfb-416a-81d1-4a934403fcce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cba8eae-5542-4c28-b8fa-79e93d2f0959", "tag": "d7eda5e9-6550-4d73-bb9c-c6d74429a2d5"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:35.296028 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-636cfc2b-50ef-4088-8cad-c8a02834d1e4 req-c68f4d4d-8cfb-416a-81d1-4a934403fcce service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:35.296500 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-636cfc2b-50ef-4088-8cad-c8a02834d1e4 req-c68f4d4d-8cfb-416a-81d1-4a934403fcce service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:35.296926 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-636cfc2b-50ef-4088-8cad-c8a02834d1e4 req-c68f4d4d-8cfb-416a-81d1-4a934403fcce service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:35.309877 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-636cfc2b-50ef-4088-8cad-c8a02834d1e4 req-c68f4d4d-8cfb-416a-81d1-4a934403fcce service nova] Creating event network-changed:d7eda5e9-6550-4d73-bb9c-c6d74429a2d5 for instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 on hv-cinder-85069 Aug 17 19:43:35.315481 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-636cfc2b-50ef-4088-8cad-c8a02834d1e4 req-c68f4d4d-8cfb-416a-81d1-4a934403fcce service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032797 Aug 17 19:43:35.316242 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 278/568] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:40.817793 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-7dda682e-0796-4d8e-802f-17636a77ec85 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-363925419"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:40.818351 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-7dda682e-0796-4d8e-802f-17636a77ec85 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:40.824266 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7dda682e-0796-4d8e-802f-17636a77ec85 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:40.825001 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7dda682e-0796-4d8e-802f-17636a77ec85 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:40.825472 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7dda682e-0796-4d8e-802f-17636a77ec85 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:40.826159 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7dda682e-0796-4d8e-802f-17636a77ec85 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:40.826613 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7dda682e-0796-4d8e-802f-17636a77ec85 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:40.827037 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7dda682e-0796-4d8e-802f-17636a77ec85 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:40.961607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.network.security_group_api [None req-7dda682e-0796-4d8e-802f-17636a77ec85 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Removing security group 672c29cc-b592-4fae-8a78-ce3997325e42 from port b5880430-ff15-4906-82f8-7fe7ec8aba19 Aug 17 19:43:41.263092 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-7dda682e-0796-4d8e-802f-17636a77ec85 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "POST /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/action" status: 202 len: 0 microversion: 2.1 time: 0.450278 Aug 17 19:43:41.263955 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 291/569] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:43:40 2022] POST /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:43:41.294936 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-82321330-8fee-4f72-a159-e799cd756a0d req-a687c747-f693-4f3f-b442-3aa109f01bbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee39152-962e-4cdf-8251-15b138a12dcc", "tag": "b5880430-ff15-4906-82f8-7fe7ec8aba19"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:41.313482 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-82321330-8fee-4f72-a159-e799cd756a0d req-a687c747-f693-4f3f-b442-3aa109f01bbb service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:41.314876 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-82321330-8fee-4f72-a159-e799cd756a0d req-a687c747-f693-4f3f-b442-3aa109f01bbb service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:41.315848 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-82321330-8fee-4f72-a159-e799cd756a0d req-a687c747-f693-4f3f-b442-3aa109f01bbb service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:41.338543 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-82321330-8fee-4f72-a159-e799cd756a0d req-a687c747-f693-4f3f-b442-3aa109f01bbb service nova] Creating event network-changed:b5880430-ff15-4906-82f8-7fe7ec8aba19 for instance 9ee39152-962e-4cdf-8251-15b138a12dcc on hv-cinder-85069 Aug 17 19:43:41.345598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-82321330-8fee-4f72-a159-e799cd756a0d req-a687c747-f693-4f3f-b442-3aa109f01bbb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056400 Aug 17 19:43:41.346497 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 279/570] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:42.389994 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-84c23625-086f-49be-85a7-8c2b47548099 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:42.390523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-84c23625-086f-49be-85a7-8c2b47548099 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:42.396628 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-84c23625-086f-49be-85a7-8c2b47548099 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:42.397107 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-84c23625-086f-49be-85a7-8c2b47548099 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:42.397712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-84c23625-086f-49be-85a7-8c2b47548099 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:42.398400 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-84c23625-086f-49be-85a7-8c2b47548099 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:42.398850 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-84c23625-086f-49be-85a7-8c2b47548099 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:42.399271 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-84c23625-086f-49be-85a7-8c2b47548099 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:42.520331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.objects.instance [None req-84c23625-086f-49be-85a7-8c2b47548099 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lazy-loading 'services' on Instance uuid 9ee39152-962e-4cdf-8251-15b138a12dcc {{(pid=132531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:43:42.637666 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-84c23625-086f-49be-85a7-8c2b47548099 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments/d47197a4-f746-4d62-81c7-736df09bdc22" status: 202 len: 0 microversion: 2.1 time: 0.251765 Aug 17 19:43:42.638873 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 292/571] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 17 19:43:42 2022] DELETE /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments/d47197a4-f746-4d62-81c7-736df09bdc22 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:43:42.649260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-699ab4fa-88d4-4012-aa30-94e7e62c0e4a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:42.651285 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-699ab4fa-88d4-4012-aa30-94e7e62c0e4a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:42.658773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-699ab4fa-88d4-4012-aa30-94e7e62c0e4a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:42.659151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-699ab4fa-88d4-4012-aa30-94e7e62c0e4a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:42.659871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-699ab4fa-88d4-4012-aa30-94e7e62c0e4a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:42.660957 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-699ab4fa-88d4-4012-aa30-94e7e62c0e4a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:42.661525 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-699ab4fa-88d4-4012-aa30-94e7e62c0e4a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:42.662099 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-699ab4fa-88d4-4012-aa30-94e7e62c0e4a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:42.666189 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:43:42.692611 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-be29543f-c34c-4262-9cda-1f3465284d77 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:42.695631 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-be29543f-c34c-4262-9cda-1f3465284d77 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:42.700657 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-699ab4fa-88d4-4012-aa30-94e7e62c0e4a tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057532 Aug 17 19:43:42.702486 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be29543f-c34c-4262-9cda-1f3465284d77 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:42.704219 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be29543f-c34c-4262-9cda-1f3465284d77 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:42.704840 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be29543f-c34c-4262-9cda-1f3465284d77 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:42.705783 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be29543f-c34c-4262-9cda-1f3465284d77 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:42.706034 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 280/572] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:43:42 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:42.706637 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be29543f-c34c-4262-9cda-1f3465284d77 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:42.707091 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-be29543f-c34c-4262-9cda-1f3465284d77 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:42.739481 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-be29543f-c34c-4262-9cda-1f3465284d77 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051252 Aug 17 19:43:42.740090 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 293/573] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:43:42 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 19:43:42.803328 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5b4b0f8e-51bf-44ea-98ad-2e1400745d3f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:42.803855 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5b4b0f8e-51bf-44ea-98ad-2e1400745d3f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:42.822108 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5b4b0f8e-51bf-44ea-98ad-2e1400745d3f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:42.822605 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5b4b0f8e-51bf-44ea-98ad-2e1400745d3f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:42.823043 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5b4b0f8e-51bf-44ea-98ad-2e1400745d3f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:42.823763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5b4b0f8e-51bf-44ea-98ad-2e1400745d3f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:42.824211 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5b4b0f8e-51bf-44ea-98ad-2e1400745d3f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:42.824627 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5b4b0f8e-51bf-44ea-98ad-2e1400745d3f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:42.850228 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5b4b0f8e-51bf-44ea-98ad-2e1400745d3f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Going to try to terminate instance {{(pid=132530) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:43:42.929954 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5b4b0f8e-51bf-44ea-98ad-2e1400745d3f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 204 len: 0 microversion: 2.1 time: 0.130218 Aug 17 19:43:42.930542 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 281/574] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:43:42 2022] DELETE /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:43:42.939299 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-20ac85ba-905f-4ec7-9571-832dc843bbc7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:42.939915 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-20ac85ba-905f-4ec7-9571-832dc843bbc7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:42.941992 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:43:42.947804 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20ac85ba-905f-4ec7-9571-832dc843bbc7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:42.948223 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20ac85ba-905f-4ec7-9571-832dc843bbc7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:42.948659 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20ac85ba-905f-4ec7-9571-832dc843bbc7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:42.949527 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20ac85ba-905f-4ec7-9571-832dc843bbc7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:42.950250 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20ac85ba-905f-4ec7-9571-832dc843bbc7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:42.950678 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20ac85ba-905f-4ec7-9571-832dc843bbc7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:43.086564 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-20ac85ba-905f-4ec7-9571-832dc843bbc7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:43.095048 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-20ac85ba-905f-4ec7-9571-832dc843bbc7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1674 microversion: 2.1 time: 0.160255 Aug 17 19:43:43.095664 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 294/575] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:42 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:43.361267 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-04228e88-5cea-4b97-9115-244f74847184 req-ea9125f7-ed80-4461-a675-134eddd40e04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee39152-962e-4cdf-8251-15b138a12dcc", "tag": "b5880430-ff15-4906-82f8-7fe7ec8aba19"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:43.370476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-04228e88-5cea-4b97-9115-244f74847184 req-ea9125f7-ed80-4461-a675-134eddd40e04 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:43.370951 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-04228e88-5cea-4b97-9115-244f74847184 req-ea9125f7-ed80-4461-a675-134eddd40e04 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:43.371379 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-04228e88-5cea-4b97-9115-244f74847184 req-ea9125f7-ed80-4461-a675-134eddd40e04 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:43.382017 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-04228e88-5cea-4b97-9115-244f74847184 req-ea9125f7-ed80-4461-a675-134eddd40e04 service nova] Creating event network-changed:b5880430-ff15-4906-82f8-7fe7ec8aba19 for instance 9ee39152-962e-4cdf-8251-15b138a12dcc on hv-cinder-85069 Aug 17 19:43:43.386847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-04228e88-5cea-4b97-9115-244f74847184 req-ea9125f7-ed80-4461-a675-134eddd40e04 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030317 Aug 17 19:43:43.387415 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 282/576] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:43.712988 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5ca34559-c303-47a4-a0b2-1a2e168442b5 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:43.715246 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5ca34559-c303-47a4-a0b2-1a2e168442b5 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:43.722308 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ca34559-c303-47a4-a0b2-1a2e168442b5 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:43.722791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ca34559-c303-47a4-a0b2-1a2e168442b5 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:43.723229 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ca34559-c303-47a4-a0b2-1a2e168442b5 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:43.723917 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ca34559-c303-47a4-a0b2-1a2e168442b5 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:43.724375 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ca34559-c303-47a4-a0b2-1a2e168442b5 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:43.724801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ca34559-c303-47a4-a0b2-1a2e168442b5 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:43.752371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5ca34559-c303-47a4-a0b2-1a2e168442b5 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043247 Aug 17 19:43:43.752879 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 295/577] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:43:43 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:44.118507 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-77ffe3a4-b1b6-448b-8b23-aa06c6603284 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:44.119225 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-77ffe3a4-b1b6-448b-8b23-aa06c6603284 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:44.126290 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77ffe3a4-b1b6-448b-8b23-aa06c6603284 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:44.126763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77ffe3a4-b1b6-448b-8b23-aa06c6603284 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:44.127194 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77ffe3a4-b1b6-448b-8b23-aa06c6603284 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:44.127874 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77ffe3a4-b1b6-448b-8b23-aa06c6603284 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:44.128322 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77ffe3a4-b1b6-448b-8b23-aa06c6603284 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:44.128738 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-77ffe3a4-b1b6-448b-8b23-aa06c6603284 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:44.258017 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-77ffe3a4-b1b6-448b-8b23-aa06c6603284 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:44.265503 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-77ffe3a4-b1b6-448b-8b23-aa06c6603284 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1674 microversion: 2.1 time: 0.151117 Aug 17 19:43:44.266058 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 283/578] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:44 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:44.764002 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-126b8741-2e84-41eb-ad76-7c1eccbeda18 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:44.766162 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-126b8741-2e84-41eb-ad76-7c1eccbeda18 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:44.772521 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-126b8741-2e84-41eb-ad76-7c1eccbeda18 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:44.773000 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-126b8741-2e84-41eb-ad76-7c1eccbeda18 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:44.773472 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-126b8741-2e84-41eb-ad76-7c1eccbeda18 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:44.774159 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-126b8741-2e84-41eb-ad76-7c1eccbeda18 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:44.774616 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-126b8741-2e84-41eb-ad76-7c1eccbeda18 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:44.775043 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-126b8741-2e84-41eb-ad76-7c1eccbeda18 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:44.803822 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-126b8741-2e84-41eb-ad76-7c1eccbeda18 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043789 Aug 17 19:43:44.804374 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 296/579] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:43:44 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:45.286861 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d0e226eb-3e63-436f-9c65-a50cc08d680a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:45.287471 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d0e226eb-3e63-436f-9c65-a50cc08d680a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:45.294339 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d0e226eb-3e63-436f-9c65-a50cc08d680a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:45.294821 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d0e226eb-3e63-436f-9c65-a50cc08d680a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:45.295282 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d0e226eb-3e63-436f-9c65-a50cc08d680a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:45.295975 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d0e226eb-3e63-436f-9c65-a50cc08d680a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:45.296449 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d0e226eb-3e63-436f-9c65-a50cc08d680a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:45.296870 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d0e226eb-3e63-436f-9c65-a50cc08d680a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:45.427994 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d0e226eb-3e63-436f-9c65-a50cc08d680a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:45.435625 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d0e226eb-3e63-436f-9c65-a50cc08d680a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1674 microversion: 2.1 time: 0.152575 Aug 17 19:43:45.436199 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 284/580] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:45 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:45.816709 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1e9c773f-76ca-4c91-9c70-fffd9f45aee3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:45.818860 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1e9c773f-76ca-4c91-9c70-fffd9f45aee3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:45.825155 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1e9c773f-76ca-4c91-9c70-fffd9f45aee3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:45.825657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1e9c773f-76ca-4c91-9c70-fffd9f45aee3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:45.826082 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1e9c773f-76ca-4c91-9c70-fffd9f45aee3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:45.826763 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1e9c773f-76ca-4c91-9c70-fffd9f45aee3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:45.827208 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1e9c773f-76ca-4c91-9c70-fffd9f45aee3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:45.827629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1e9c773f-76ca-4c91-9c70-fffd9f45aee3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:45.856006 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1e9c773f-76ca-4c91-9c70-fffd9f45aee3 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043849 Aug 17 19:43:45.856577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 297/581] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:43:45 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 19:43:45.867543 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ced3b972-bfa8-4906-aa1e-e3a619de8674 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:45.868038 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ced3b972-bfa8-4906-aa1e-e3a619de8674 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:45.873847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ced3b972-bfa8-4906-aa1e-e3a619de8674 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:45.874329 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ced3b972-bfa8-4906-aa1e-e3a619de8674 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:45.874763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ced3b972-bfa8-4906-aa1e-e3a619de8674 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:45.876123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ced3b972-bfa8-4906-aa1e-e3a619de8674 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:45.876569 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ced3b972-bfa8-4906-aa1e-e3a619de8674 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:45.876987 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ced3b972-bfa8-4906-aa1e-e3a619de8674 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:45.954177 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-ced3b972-bfa8-4906-aa1e-e3a619de8674 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] HTTP exception thrown: Instance 9ee39152-962e-4cdf-8251-15b138a12dcc is not attached to volume d47197a4-f746-4d62-81c7-736df09bdc22 Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ced3b972-bfa8-4906-aa1e-e3a619de8674 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Request method failure captured: Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: DELETE /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments/d47197a4-f746-4d62-81c7-736df09bdc22 HTTP/1.1 Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UQxPWvOQ0d0nHHta4A5TKiImuEOhoAWGXoxmSBnqwCxGZAM9yBG1X4kwXw2LW1EaCfZrT0LJchRD-kfaBQf2cMNVaBWrHSsQGzBnGuRnmhxYfXglyo6T2MfP0RXzYXX9i3ylPHVK6y9VasaDdN8n55_YHg4C39PDMSYM9O5HOQunVk Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: cd2089b2265341b291a0db883f0d211f Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-TestMinimumBasicScenario-1888307559 Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:43:45.960981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:43:45.962652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cd2089b2265341b291a0db883f0d211f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cd2089b2265341b291a0db883f0d211f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cd2089b2265341b291a0db883f0d211f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cd2089b2265341b291a0db883f0d211f"}]}] Aug 17 19:43:45.962652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-TestMinimumBasicScenario-1888307559 Aug 17 19:43:45.962652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: cd2089b2265341b291a0db883f0d211f Aug 17 19:43:45.962652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1888307559 Aug 17 19:43:45.962652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-TestMinimumBasicScenario-1888307559-project Aug 17 19:43:45.962652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:43:45.962652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:43:45.962652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 0fbaae2c269740158bed223697bde03d Aug 17 19:43:45.962652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-TestMinimumBasicScenario-1888307559-project Aug 17 19:43:45.962652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:43:45.962652 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 9ee39152-962e-4cdf-8251-15b138a12dcc is not attached to volume d47197a4-f746-4d62-81c7-736df09bdc22 Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'server_id': '9ee39152-962e-4cdf-8251-15b138a12dcc', 'id': 'd47197a4-f746-4d62-81c7-736df09bdc22'} Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d47197a4-f746-4d62-81c7-736df09bdc22. Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:43:45.963476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee39152-962e-4cdf-8251-15b138a12dcc is not attached to volume d47197a4-f746-4d62-81c7-736df09bdc22 Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee39152-962e-4cdf-8251-15b138a12dcc is not attached to volume d47197a4-f746-4d62-81c7-736df09bdc22 Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:45.964705 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ced3b972-bfa8-4906-aa1e-e3a619de8674 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Returning 404 to user: Instance 9ee39152-962e-4cdf-8251-15b138a12dcc is not attached to volume d47197a4-f746-4d62-81c7-736df09bdc22 {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:43:45.965670 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ced3b972-bfa8-4906-aa1e-e3a619de8674 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments/d47197a4-f746-4d62-81c7-736df09bdc22" status: 404 len: 154 microversion: 2.1 time: 0.098960 Aug 17 19:43:45.965670 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 285/582] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 17 19:43:45 2022] DELETE /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc/os-volume_attachments/d47197a4-f746-4d62-81c7-736df09bdc22 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 19:43:46.457735 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1c259d51-63e2-4016-9b58-09941a7821b7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:46.458523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1c259d51-63e2-4016-9b58-09941a7821b7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:46.464521 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c259d51-63e2-4016-9b58-09941a7821b7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:46.465092 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c259d51-63e2-4016-9b58-09941a7821b7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:46.465692 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c259d51-63e2-4016-9b58-09941a7821b7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:46.466443 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c259d51-63e2-4016-9b58-09941a7821b7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:46.466963 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c259d51-63e2-4016-9b58-09941a7821b7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:46.467448 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c259d51-63e2-4016-9b58-09941a7821b7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:46.528722 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1c259d51-63e2-4016-9b58-09941a7821b7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:46.536382 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1c259d51-63e2-4016-9b58-09941a7821b7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 200 len: 1606 microversion: 2.1 time: 0.083080 Aug 17 19:43:46.536952 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 298/583] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:46 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 1606 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:46.704488 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-3601bc0a-300d-4eb4-a305-30739781f01c req-4c16d889-0a7e-4349-8d18-4b7449689900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0602879a-bbc5-4632-8412-a72ea55b9068", "name": "network-vif-deleted", "tag": "6a3e0e5d-86b3-4661-9b06-02498556723f"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:46.716626 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-3601bc0a-300d-4eb4-a305-30739781f01c req-4c16d889-0a7e-4349-8d18-4b7449689900 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:46.717116 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-3601bc0a-300d-4eb4-a305-30739781f01c req-4c16d889-0a7e-4349-8d18-4b7449689900 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:46.717583 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-3601bc0a-300d-4eb4-a305-30739781f01c req-4c16d889-0a7e-4349-8d18-4b7449689900 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:46.729128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-3601bc0a-300d-4eb4-a305-30739781f01c req-4c16d889-0a7e-4349-8d18-4b7449689900 service nova] Creating event network-vif-deleted:6a3e0e5d-86b3-4661-9b06-02498556723f for instance 0602879a-bbc5-4632-8412-a72ea55b9068 on hv-cinder-85069 Aug 17 19:43:46.734019 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-3601bc0a-300d-4eb4-a305-30739781f01c req-4c16d889-0a7e-4349-8d18-4b7449689900 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033907 Aug 17 19:43:46.735125 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 286/584] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:47.104468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-47a6c20d-c2fc-4285-9be1-e65bf1381899 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:47.104996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-47a6c20d-c2fc-4285-9be1-e65bf1381899 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:47.111977 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-47a6c20d-c2fc-4285-9be1-e65bf1381899 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:47.112463 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-47a6c20d-c2fc-4285-9be1-e65bf1381899 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:47.112896 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-47a6c20d-c2fc-4285-9be1-e65bf1381899 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:47.113810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-47a6c20d-c2fc-4285-9be1-e65bf1381899 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:47.114426 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-47a6c20d-c2fc-4285-9be1-e65bf1381899 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:47.114854 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-47a6c20d-c2fc-4285-9be1-e65bf1381899 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:47.140979 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-47a6c20d-c2fc-4285-9be1-e65bf1381899 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:43:47.226489 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-47a6c20d-c2fc-4285-9be1-e65bf1381899 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 204 len: 0 microversion: 2.1 time: 0.125483 Aug 17 19:43:47.230227 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 299/585] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:43:47 2022] DELETE /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:43:47.237763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c6dd82ee-1430-4c9e-94a6-60f2b794a772 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:47.238876 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c6dd82ee-1430-4c9e-94a6-60f2b794a772 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:47.245460 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c6dd82ee-1430-4c9e-94a6-60f2b794a772 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:47.245954 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c6dd82ee-1430-4c9e-94a6-60f2b794a772 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:47.246380 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c6dd82ee-1430-4c9e-94a6-60f2b794a772 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:47.247254 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c6dd82ee-1430-4c9e-94a6-60f2b794a772 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:47.247864 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c6dd82ee-1430-4c9e-94a6-60f2b794a772 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:47.248603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c6dd82ee-1430-4c9e-94a6-60f2b794a772 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:47.387602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c6dd82ee-1430-4c9e-94a6-60f2b794a772 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:47.395676 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c6dd82ee-1430-4c9e-94a6-60f2b794a772 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1554 microversion: 2.1 time: 0.163744 Aug 17 19:43:47.396235 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 287/586] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:47 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:47.558472 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1c472b1e-e607-4c00-823d-f296e093faa9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:47.559175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1c472b1e-e607-4c00-823d-f296e093faa9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:47.569616 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c472b1e-e607-4c00-823d-f296e093faa9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:47.570117 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c472b1e-e607-4c00-823d-f296e093faa9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:47.570558 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c472b1e-e607-4c00-823d-f296e093faa9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:47.571268 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c472b1e-e607-4c00-823d-f296e093faa9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:47.571730 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c472b1e-e607-4c00-823d-f296e093faa9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:47.572155 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c472b1e-e607-4c00-823d-f296e093faa9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:47.575345 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:43:47.588029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-1c472b1e-e607-4c00-823d-f296e093faa9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] HTTP exception thrown: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1c472b1e-e607-4c00-823d-f296e093faa9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Request method failure captured: Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 HTTP/1.1 Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPfXD1ndUVYJ7hH7H4oWcdTbPJtAirxbKC83GBbpzadUv-bSOs-IpNMrPiexeQZ25DshurFFhyonDk_UlF15S9wi4sJJ8E-u2w-iRJuP33fdm7s4JvS5p2QfNXSGD57NNGck2XAQ_ZqHccAx_Wa-x0Bo96sOdwSpYfRuS7cnE0CD3I Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: d8e17f7523b4492394df211a01a4193c Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:43:47.589689 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:43:47.591132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d8e17f7523b4492394df211a01a4193c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d8e17f7523b4492394df211a01a4193c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d8e17f7523b4492394df211a01a4193c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d8e17f7523b4492394df211a01a4193c"}]}] Aug 17 19:43:47.591132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:43:47.591132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: d8e17f7523b4492394df211a01a4193c Aug 17 19:43:47.591132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:43:47.591132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-AttachVolumeTestJSON-984721636-project Aug 17 19:43:47.591132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:43:47.591132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:43:47.591132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: f698e4a2f6074756adc52f6b6b9ff9fd Aug 17 19:43:47.591132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-AttachVolumeTestJSON-984721636-project Aug 17 19:43:47.591132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:43:47.591132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:43:47.591132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '0602879a-bbc5-4632-8412-a72ea55b9068'} Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:43:47.596626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:43:47.598343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:43:47.599758 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1c472b1e-e607-4c00-823d-f296e093faa9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Returning 404 to user: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:43:47.599758 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1c472b1e-e607-4c00-823d-f296e093faa9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 404 len: 111 microversion: 2.1 time: 0.036801 Aug 17 19:43:47.599758 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 300/587] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:47 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:43:47.601440 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6bc6b825-c56d-40a6-89de-5aa6aa237ec8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '.version_select at 0x7f368a016790>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:47.624759 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-6bc6b825-c56d-40a6-89de-5aa6aa237ec8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729813087" status: 202 len: 0 microversion: 2.1 time: 0.027768 Aug 17 19:43:47.625971 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 288/588] 10.222.0.59 () {58 vars in 1221 bytes} [Wed Aug 17 19:43:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729813087 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:43:48.244680 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5199a6b8-1c2f-4abf-a887-9485156bb06c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Action: 'create', calling method: .version_select at 0x7f368a0665e0>, body: {"keypair": {"name": "tempest-keypair-455260183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKw9p+tKd075zZ8w4v2G9tLbAu61kdpCeH9QiqruD2Zp/x9iJ/+xymOftMFe3fVKoYOSLnuJS694CzcZdhbMSsgWaU7wSN7Wyaec9uudCV4wYKViJtHsIHxZMBOAn0N7lw=="}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:48.262234 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-5199a6b8-1c2f-4abf-a887-9485156bb06c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Getting quotas for project d8e17f7523b4492394df211a01a4193c. Resources: {'key_pairs'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:43:48.266046 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-5199a6b8-1c2f-4abf-a887-9485156bb06c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Getting quotas for user f698e4a2f6074756adc52f6b6b9ff9fd and project d8e17f7523b4492394df211a01a4193c. Resources: {'key_pairs'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:43:48.287347 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5199a6b8-1c2f-4abf-a887-9485156bb06c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046539 Aug 17 19:43:48.287921 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 301/589] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 17 19:43:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:48.417720 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-76559ff5-5cc6-4aa3-8f46-11c6cd88f781 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:48.418323 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-76559ff5-5cc6-4aa3-8f46-11c6cd88f781 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:48.425851 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76559ff5-5cc6-4aa3-8f46-11c6cd88f781 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:48.426512 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76559ff5-5cc6-4aa3-8f46-11c6cd88f781 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:48.427182 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76559ff5-5cc6-4aa3-8f46-11c6cd88f781 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:48.428058 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76559ff5-5cc6-4aa3-8f46-11c6cd88f781 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:48.428667 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76559ff5-5cc6-4aa3-8f46-11c6cd88f781 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:48.429275 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76559ff5-5cc6-4aa3-8f46-11c6cd88f781 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:48.829795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-76559ff5-5cc6-4aa3-8f46-11c6cd88f781 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:48.837551 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-76559ff5-5cc6-4aa3-8f46-11c6cd88f781 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1554 microversion: 2.1 time: 0.424976 Aug 17 19:43:48.838147 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 289/590] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:48 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1554 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:49.861091 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-59c3d68b-7458-4815-8e1d-70073d015b81 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:49.861732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-59c3d68b-7458-4815-8e1d-70073d015b81 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:49.868255 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59c3d68b-7458-4815-8e1d-70073d015b81 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:49.868951 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59c3d68b-7458-4815-8e1d-70073d015b81 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:49.869422 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59c3d68b-7458-4815-8e1d-70073d015b81 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:49.870112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59c3d68b-7458-4815-8e1d-70073d015b81 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:49.870564 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59c3d68b-7458-4815-8e1d-70073d015b81 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:49.870984 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59c3d68b-7458-4815-8e1d-70073d015b81 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:50.009738 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-59c3d68b-7458-4815-8e1d-70073d015b81 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fbaae2c269740158bed223697bde03d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd2089b2265341b291a0db883f0d211f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:50.017592 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1740070417", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "efd33d7e-e98e-4b70-ba3d-e5bc9d6e97e0"}], "security_groups": [{"name": "tempest-securitygroup--1101271622"}], "key_name": "tempest-keypair-455260183", "user_data": "}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:50.018462 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-59c3d68b-7458-4815-8e1d-70073d015b81 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 200 len: 1554 microversion: 2.1 time: 0.162209 Aug 17 19:43:50.019113 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 302/591] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:49 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:50.131029 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.network.neutron [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] validate_networks() for [('efd33d7e-e98e-4b70-ba3d-e5bc9d6e97e0', None, None, None, None, None)] {{(pid=132530) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:43:50.138312 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-53214ef7-4b3a-4d7f-a02f-66d170f3a33e req-f26f0eef-b57d-4fe8-b485-401a81114f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee39152-962e-4cdf-8251-15b138a12dcc", "name": "network-vif-deleted", "tag": "b5880430-ff15-4906-82f8-7fe7ec8aba19"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:50.148425 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-53214ef7-4b3a-4d7f-a02f-66d170f3a33e req-f26f0eef-b57d-4fe8-b485-401a81114f49 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:50.148905 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-53214ef7-4b3a-4d7f-a02f-66d170f3a33e req-f26f0eef-b57d-4fe8-b485-401a81114f49 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:50.149368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-53214ef7-4b3a-4d7f-a02f-66d170f3a33e req-f26f0eef-b57d-4fe8-b485-401a81114f49 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:50.161707 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-53214ef7-4b3a-4d7f-a02f-66d170f3a33e req-f26f0eef-b57d-4fe8-b485-401a81114f49 service nova] Creating event network-vif-deleted:b5880430-ff15-4906-82f8-7fe7ec8aba19 for instance 9ee39152-962e-4cdf-8251-15b138a12dcc on hv-cinder-85069 Aug 17 19:43:50.166622 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-53214ef7-4b3a-4d7f-a02f-66d170f3a33e req-f26f0eef-b57d-4fe8-b485-401a81114f49 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032161 Aug 17 19:43:50.167529 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 303/592] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:43:50.511879 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Flavor limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:43:50.512305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Image limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:43:50.512779 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Flavor pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:43:50.513189 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Image pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:43:50.513668 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:43:50.515788 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:43:50.525677 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:50.526165 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:50.526605 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:50.527367 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:50.527826 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:50.528252 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:50.549614 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Getting quotas for project d8e17f7523b4492394df211a01a4193c. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:43:50.554621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Getting quotas for user f698e4a2f6074756adc52f6b6b9ff9fd and project d8e17f7523b4492394df211a01a4193c. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:43:50.567051 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Going to run 1 instances... {{(pid=132530) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:43:50.569107 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132530) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:43:50.619817 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d6cd2ec3-bd33-4ae1-8a44-5f3e6b028d91 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.606452 Aug 17 19:43:50.620480 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 290/593] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:43:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 19:43:50.631921 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3d1e05dd-ec52-46d2-91f1-1daea17b71c4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:50.632730 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3d1e05dd-ec52-46d2-91f1-1daea17b71c4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:50.696535 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3d1e05dd-ec52-46d2-91f1-1daea17b71c4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:50.704867 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3d1e05dd-ec52-46d2-91f1-1daea17b71c4 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1237 microversion: 2.1 time: 0.077005 Aug 17 19:43:50.705711 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 304/594] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:50 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:51.039995 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-92529395-f65d-4efe-96fc-a33ce4917109 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:51.040592 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-92529395-f65d-4efe-96fc-a33ce4917109 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] [instance: 9ee39152-962e-4cdf-8251-15b138a12dcc] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:51.047550 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-92529395-f65d-4efe-96fc-a33ce4917109 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:51.048286 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-92529395-f65d-4efe-96fc-a33ce4917109 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:51.048735 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-92529395-f65d-4efe-96fc-a33ce4917109 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:51.049467 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-92529395-f65d-4efe-96fc-a33ce4917109 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:51.049923 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-92529395-f65d-4efe-96fc-a33ce4917109 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:51.050346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-92529395-f65d-4efe-96fc-a33ce4917109 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:51.064228 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-92529395-f65d-4efe-96fc-a33ce4917109 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] HTTP exception thrown: Instance 9ee39152-962e-4cdf-8251-15b138a12dcc could not be found. Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-92529395-f65d-4efe-96fc-a33ce4917109 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Request method failure captured: Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc HTTP/1.1 Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UQxPWvOQ0d0nHHta4A5TKiImuEOhoAWGXoxmSBnqwCxGZAM9yBG1X4kwXw2LW1EaCfZrT0LJchRD-kfaBQf2cMNVaBWrHSsQGzBnGuRnmhxYfXglyo6T2MfP0RXzYXX9i3ylPHVK6y9VasaDdN8n55_YHg4C39PDMSYM9O5HOQunVk Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: cd2089b2265341b291a0db883f0d211f Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-TestMinimumBasicScenario-1888307559 Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:43:51.065896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:43:51.067446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/cd2089b2265341b291a0db883f0d211f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cd2089b2265341b291a0db883f0d211f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_cd2089b2265341b291a0db883f0d211f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/cd2089b2265341b291a0db883f0d211f"}]}] Aug 17 19:43:51.067446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-TestMinimumBasicScenario-1888307559 Aug 17 19:43:51.067446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: cd2089b2265341b291a0db883f0d211f Aug 17 19:43:51.067446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1888307559 Aug 17 19:43:51.067446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-TestMinimumBasicScenario-1888307559-project Aug 17 19:43:51.067446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:43:51.067446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:43:51.067446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 0fbaae2c269740158bed223697bde03d Aug 17 19:43:51.067446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-TestMinimumBasicScenario-1888307559-project Aug 17 19:43:51.067446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:43:51.067446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 9ee39152-962e-4cdf-8251-15b138a12dcc could not be found. Aug 17 19:43:51.067446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '9ee39152-962e-4cdf-8251-15b138a12dcc'} Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee39152-962e-4cdf-8251-15b138a12dcc could not be found. Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:43:51.068325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee39152-962e-4cdf-8251-15b138a12dcc could not be found. Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee39152-962e-4cdf-8251-15b138a12dcc could not be found. Aug 17 19:43:51.069867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:43:51.071287 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-92529395-f65d-4efe-96fc-a33ce4917109 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Returning 404 to user: Instance 9ee39152-962e-4cdf-8251-15b138a12dcc could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:43:51.071287 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-92529395-f65d-4efe-96fc-a33ce4917109 tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc" status: 404 len: 111 microversion: 2.1 time: 0.031317 Aug 17 19:43:51.071287 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 291/595] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:51 2022] GET /compute/v2.1/servers/9ee39152-962e-4cdf-8251-15b138a12dcc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:43:51.076298 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-7a5760c3-7887-4b4e-a996-53a6b61da5dc tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] Calling method '.version_select at 0x7f368a00b790>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:51.096517 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-7a5760c3-7887-4b4e-a996-53a6b61da5dc tempest-TestMinimumBasicScenario-1888307559 tempest-TestMinimumBasicScenario-1888307559-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1876399247" status: 202 len: 0 microversion: 2.1 time: 0.024150 Aug 17 19:43:51.097086 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 305/596] 10.222.0.59 () {58 vars in 1272 bytes} [Wed Aug 17 19:43:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1876399247 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:43:51.726678 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-bb355e83-52c8-4d88-9cd9-32f05b7b015a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:51.727566 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-bb355e83-52c8-4d88-9cd9-32f05b7b015a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:51.744491 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb355e83-52c8-4d88-9cd9-32f05b7b015a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:51.744993 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb355e83-52c8-4d88-9cd9-32f05b7b015a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:51.745464 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb355e83-52c8-4d88-9cd9-32f05b7b015a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:51.746180 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb355e83-52c8-4d88-9cd9-32f05b7b015a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:51.746640 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb355e83-52c8-4d88-9cd9-32f05b7b015a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:51.747068 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bb355e83-52c8-4d88-9cd9-32f05b7b015a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:51.825057 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-bb355e83-52c8-4d88-9cd9-32f05b7b015a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:51.833818 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-bb355e83-52c8-4d88-9cd9-32f05b7b015a tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1307 microversion: 2.1 time: 0.111847 Aug 17 19:43:51.848241 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 292/597] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:51 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:52.855996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-151e7580-996c-47f3-a171-6dab6ab01e14 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:52.857274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-151e7580-996c-47f3-a171-6dab6ab01e14 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:52.863978 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-151e7580-996c-47f3-a171-6dab6ab01e14 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:52.864795 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-151e7580-996c-47f3-a171-6dab6ab01e14 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:52.864914 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-151e7580-996c-47f3-a171-6dab6ab01e14 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:52.865785 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-151e7580-996c-47f3-a171-6dab6ab01e14 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:52.866236 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-151e7580-996c-47f3-a171-6dab6ab01e14 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:52.866654 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-151e7580-996c-47f3-a171-6dab6ab01e14 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:52.993550 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-36b74c45-ad85-4df5-abcb-43841c6bd336 req-287c1887-fe07-4da2-a79d-3f3204b1232f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c8ca5b1-5ab2-48cf-824d-367bbac94eb0", "tag": "8d0240ee-c805-4cfa-aded-24a776b15f49"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:53.014067 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-36b74c45-ad85-4df5-abcb-43841c6bd336 req-287c1887-fe07-4da2-a79d-3f3204b1232f service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:53.014545 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-36b74c45-ad85-4df5-abcb-43841c6bd336 req-287c1887-fe07-4da2-a79d-3f3204b1232f service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:53.014966 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-36b74c45-ad85-4df5-abcb-43841c6bd336 req-287c1887-fe07-4da2-a79d-3f3204b1232f service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:53.028431 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-36b74c45-ad85-4df5-abcb-43841c6bd336 req-287c1887-fe07-4da2-a79d-3f3204b1232f service nova] Creating event network-changed:8d0240ee-c805-4cfa-aded-24a776b15f49 for instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 on hv-cinder-85069 Aug 17 19:43:53.034908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-36b74c45-ad85-4df5-abcb-43841c6bd336 req-287c1887-fe07-4da2-a79d-3f3204b1232f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046377 Aug 17 19:43:53.035538 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 293/598] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:53.112733 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-151e7580-996c-47f3-a171-6dab6ab01e14 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:53.120824 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-151e7580-996c-47f3-a171-6dab6ab01e14 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1363 microversion: 2.1 time: 0.269309 Aug 17 19:43:53.121676 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 306/599] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:52 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1363 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:54.143554 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-25e68d7c-85f8-4d72-ba9f-68b5eb23e1da tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:54.145025 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-25e68d7c-85f8-4d72-ba9f-68b5eb23e1da tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:54.152159 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25e68d7c-85f8-4d72-ba9f-68b5eb23e1da tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:54.152651 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25e68d7c-85f8-4d72-ba9f-68b5eb23e1da tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:54.153093 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25e68d7c-85f8-4d72-ba9f-68b5eb23e1da tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:54.153836 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25e68d7c-85f8-4d72-ba9f-68b5eb23e1da tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:54.154480 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25e68d7c-85f8-4d72-ba9f-68b5eb23e1da tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:54.154910 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25e68d7c-85f8-4d72-ba9f-68b5eb23e1da tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:54.426006 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-25e68d7c-85f8-4d72-ba9f-68b5eb23e1da tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:54.433768 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-25e68d7c-85f8-4d72-ba9f-68b5eb23e1da tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1363 microversion: 2.1 time: 0.295010 Aug 17 19:43:54.434335 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 294/600] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:54 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1363 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:55.305845 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3a06185c-bb03-4df9-a09c-d2ad3a4c4a17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:55.306361 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3a06185c-bb03-4df9-a09c-d2ad3a4c4a17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:55.313142 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3a06185c-bb03-4df9-a09c-d2ad3a4c4a17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:55.313665 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3a06185c-bb03-4df9-a09c-d2ad3a4c4a17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:55.314293 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3a06185c-bb03-4df9-a09c-d2ad3a4c4a17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:55.315001 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3a06185c-bb03-4df9-a09c-d2ad3a4c4a17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:55.315458 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3a06185c-bb03-4df9-a09c-d2ad3a4c4a17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:55.315885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3a06185c-bb03-4df9-a09c-d2ad3a4c4a17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:55.455810 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c285aec6-2d49-4afa-b0cc-012c3ff0bdff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:55.456922 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c285aec6-2d49-4afa-b0cc-012c3ff0bdff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:55.462853 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c285aec6-2d49-4afa-b0cc-012c3ff0bdff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:55.463429 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c285aec6-2d49-4afa-b0cc-012c3ff0bdff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:55.463784 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c285aec6-2d49-4afa-b0cc-012c3ff0bdff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:55.464933 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c285aec6-2d49-4afa-b0cc-012c3ff0bdff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:55.465602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c285aec6-2d49-4afa-b0cc-012c3ff0bdff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:55.466286 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c285aec6-2d49-4afa-b0cc-012c3ff0bdff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:55.523417 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.objects.instance [None req-3a06185c-bb03-4df9-a09c-d2ad3a4c4a17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lazy-loading 'services' on Instance uuid be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb {{(pid=132531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:43:55.601970 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3a06185c-bb03-4df9-a09c-d2ad3a4c4a17 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "DELETE /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-volume_attachments/89cc6d49-7590-4be6-92e3-c18f0d6bdce1" status: 202 len: 0 microversion: 2.1 time: 0.299764 Aug 17 19:43:55.606641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 307/601] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 17 19:43:55 2022] DELETE /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-volume_attachments/89cc6d49-7590-4be6-92e3-c18f0d6bdce1 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:43:55.618652 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-255cda8e-2e44-4fdc-8ee0-c6ac4beb7295 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:55.621385 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-255cda8e-2e44-4fdc-8ee0-c6ac4beb7295 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:55.628173 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-255cda8e-2e44-4fdc-8ee0-c6ac4beb7295 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:55.628938 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-255cda8e-2e44-4fdc-8ee0-c6ac4beb7295 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:55.629612 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-255cda8e-2e44-4fdc-8ee0-c6ac4beb7295 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:55.630936 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-255cda8e-2e44-4fdc-8ee0-c6ac4beb7295 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:55.631682 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-255cda8e-2e44-4fdc-8ee0-c6ac4beb7295 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:55.632414 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-255cda8e-2e44-4fdc-8ee0-c6ac4beb7295 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:55.671243 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-255cda8e-2e44-4fdc-8ee0-c6ac4beb7295 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062456 Aug 17 19:43:55.676298 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 308/602] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:43:55 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:55.717088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c285aec6-2d49-4afa-b0cc-012c3ff0bdff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:55.729508 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c285aec6-2d49-4afa-b0cc-012c3ff0bdff tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1363 microversion: 2.1 time: 0.278459 Aug 17 19:43:55.730375 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 295/603] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:55 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1363 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:43:56.683737 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5836c872-571f-4c30-bc1b-acc8f5b684b8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:56.686003 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5836c872-571f-4c30-bc1b-acc8f5b684b8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:56.692635 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5836c872-571f-4c30-bc1b-acc8f5b684b8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:56.693472 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5836c872-571f-4c30-bc1b-acc8f5b684b8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:56.694086 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5836c872-571f-4c30-bc1b-acc8f5b684b8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:56.694909 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5836c872-571f-4c30-bc1b-acc8f5b684b8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:56.695585 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5836c872-571f-4c30-bc1b-acc8f5b684b8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:56.696111 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5836c872-571f-4c30-bc1b-acc8f5b684b8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:56.731143 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5836c872-571f-4c30-bc1b-acc8f5b684b8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051325 Aug 17 19:43:56.731713 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 309/604] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:43:56 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 19:43:56.750121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-da6d4b6c-9d0e-47f8-aaa0-ae790e619053 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:56.751301 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-da6d4b6c-9d0e-47f8-aaa0-ae790e619053 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:56.758201 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-da6d4b6c-9d0e-47f8-aaa0-ae790e619053 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:56.758684 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-da6d4b6c-9d0e-47f8-aaa0-ae790e619053 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:56.759117 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-da6d4b6c-9d0e-47f8-aaa0-ae790e619053 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:56.759814 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-da6d4b6c-9d0e-47f8-aaa0-ae790e619053 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:56.760268 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-da6d4b6c-9d0e-47f8-aaa0-ae790e619053 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:56.760874 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-da6d4b6c-9d0e-47f8-aaa0-ae790e619053 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:56.809767 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8dd44a65-fbf2-4501-9a97-377d0c3cab4a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:56.810544 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-8dd44a65-fbf2-4501-9a97-377d0c3cab4a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:56.816985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8dd44a65-fbf2-4501-9a97-377d0c3cab4a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:56.817573 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8dd44a65-fbf2-4501-9a97-377d0c3cab4a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:56.818110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8dd44a65-fbf2-4501-9a97-377d0c3cab4a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:56.819118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8dd44a65-fbf2-4501-9a97-377d0c3cab4a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:56.819735 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8dd44a65-fbf2-4501-9a97-377d0c3cab4a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:56.820559 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8dd44a65-fbf2-4501-9a97-377d0c3cab4a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:56.848314 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-8dd44a65-fbf2-4501-9a97-377d0c3cab4a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:43:56.917964 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-da6d4b6c-9d0e-47f8-aaa0-ae790e619053 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:56.933664 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-da6d4b6c-9d0e-47f8-aaa0-ae790e619053 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1363 microversion: 2.1 time: 0.186572 Aug 17 19:43:56.934967 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 296/605] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:56 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:56.948118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8dd44a65-fbf2-4501-9a97-377d0c3cab4a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "DELETE /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 204 len: 0 microversion: 2.1 time: 0.142141 Aug 17 19:43:56.949243 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 310/606] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:43:56 2022] DELETE /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:43:56.960516 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-801d443f-156a-4490-88ce-37adb3a5e957 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:56.961273 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-801d443f-156a-4490-88ce-37adb3a5e957 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:56.967325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-801d443f-156a-4490-88ce-37adb3a5e957 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:56.967926 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-801d443f-156a-4490-88ce-37adb3a5e957 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:56.969039 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-801d443f-156a-4490-88ce-37adb3a5e957 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:56.969832 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-801d443f-156a-4490-88ce-37adb3a5e957 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:56.970363 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-801d443f-156a-4490-88ce-37adb3a5e957 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:56.970861 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-801d443f-156a-4490-88ce-37adb3a5e957 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:57.115569 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-801d443f-156a-4490-88ce-37adb3a5e957 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:57.123051 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-801d443f-156a-4490-88ce-37adb3a5e957 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1691 microversion: 2.1 time: 0.166401 Aug 17 19:43:57.123619 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 297/607] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:56 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:57.956950 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5688ae05-0708-4311-aa90-760c63736627 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:57.957724 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5688ae05-0708-4311-aa90-760c63736627 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:57.964075 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5688ae05-0708-4311-aa90-760c63736627 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:57.964565 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5688ae05-0708-4311-aa90-760c63736627 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:57.965002 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5688ae05-0708-4311-aa90-760c63736627 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:57.965728 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5688ae05-0708-4311-aa90-760c63736627 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:57.966183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5688ae05-0708-4311-aa90-760c63736627 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:57.966608 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5688ae05-0708-4311-aa90-760c63736627 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:58.105329 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5688ae05-0708-4311-aa90-760c63736627 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:58.113634 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5688ae05-0708-4311-aa90-760c63736627 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1363 microversion: 2.1 time: 0.161325 Aug 17 19:43:58.114698 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 311/608] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:57 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:58.145594 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b8d100d2-3b21-4409-b57d-227d4beaabe1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:58.147216 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b8d100d2-3b21-4409-b57d-227d4beaabe1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:58.154055 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8d100d2-3b21-4409-b57d-227d4beaabe1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:58.154845 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8d100d2-3b21-4409-b57d-227d4beaabe1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:58.155475 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8d100d2-3b21-4409-b57d-227d4beaabe1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:58.156404 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8d100d2-3b21-4409-b57d-227d4beaabe1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:58.157129 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8d100d2-3b21-4409-b57d-227d4beaabe1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:58.157785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8d100d2-3b21-4409-b57d-227d4beaabe1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:58.317766 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b8d100d2-3b21-4409-b57d-227d4beaabe1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:58.325552 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b8d100d2-3b21-4409-b57d-227d4beaabe1 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1691 microversion: 2.1 time: 0.185543 Aug 17 19:43:58.326127 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 298/609] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:58 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1691 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:59.135543 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c10c17f0-341b-44b1-9d4f-e2db62204714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:59.136156 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-c10c17f0-341b-44b1-9d4f-e2db62204714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:59.142772 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c10c17f0-341b-44b1-9d4f-e2db62204714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:59.143710 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c10c17f0-341b-44b1-9d4f-e2db62204714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:59.144295 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c10c17f0-341b-44b1-9d4f-e2db62204714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:59.145258 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c10c17f0-341b-44b1-9d4f-e2db62204714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:59.145804 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c10c17f0-341b-44b1-9d4f-e2db62204714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:59.146435 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c10c17f0-341b-44b1-9d4f-e2db62204714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:59.221533 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-580599a1-613d-495c-8f88-dea9ad22e72c req-2b601031-9128-46ee-bd0a-524b3b070166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8ca5b1-5ab2-48cf-824d-367bbac94eb0", "name": "network-vif-plugged", "status": "completed", "tag": "8d0240ee-c805-4cfa-aded-24a776b15f49"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:43:59.231625 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-580599a1-613d-495c-8f88-dea9ad22e72c req-2b601031-9128-46ee-bd0a-524b3b070166 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:59.232336 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-580599a1-613d-495c-8f88-dea9ad22e72c req-2b601031-9128-46ee-bd0a-524b3b070166 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:59.233129 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-580599a1-613d-495c-8f88-dea9ad22e72c req-2b601031-9128-46ee-bd0a-524b3b070166 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:59.246650 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-580599a1-613d-495c-8f88-dea9ad22e72c req-2b601031-9128-46ee-bd0a-524b3b070166 service nova] Creating event network-vif-plugged:8d0240ee-c805-4cfa-aded-24a776b15f49 for instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 on hv-cinder-85069 Aug 17 19:43:59.252840 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-580599a1-613d-495c-8f88-dea9ad22e72c req-2b601031-9128-46ee-bd0a-524b3b070166 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034861 Aug 17 19:43:59.254315 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 299/610] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:43:59.297745 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-c10c17f0-341b-44b1-9d4f-e2db62204714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:59.306329 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-c10c17f0-341b-44b1-9d4f-e2db62204714 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1363 microversion: 2.1 time: 0.174524 Aug 17 19:43:59.307331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 312/611] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:59 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:43:59.346699 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-07bef20d-cfcf-4da4-b634-18ebd53a72ba tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:43:59.347691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-07bef20d-cfcf-4da4-b634-18ebd53a72ba tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:43:59.353681 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-07bef20d-cfcf-4da4-b634-18ebd53a72ba tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:59.354198 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-07bef20d-cfcf-4da4-b634-18ebd53a72ba tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:59.354645 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-07bef20d-cfcf-4da4-b634-18ebd53a72ba tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:59.355332 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-07bef20d-cfcf-4da4-b634-18ebd53a72ba tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:43:59.355785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-07bef20d-cfcf-4da4-b634-18ebd53a72ba tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:43:59.356207 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-07bef20d-cfcf-4da4-b634-18ebd53a72ba tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:43:59.360470 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:43:59.505272 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-07bef20d-cfcf-4da4-b634-18ebd53a72ba tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:43:59.513014 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-07bef20d-cfcf-4da4-b634-18ebd53a72ba tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1691 microversion: 2.1 time: 0.171219 Aug 17 19:43:59.513807 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 300/612] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:43:59 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:00.328568 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9dc41c0a-1840-4e55-b2d4-5e9e3b2e0abf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:00.329183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9dc41c0a-1840-4e55-b2d4-5e9e3b2e0abf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:00.335533 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9dc41c0a-1840-4e55-b2d4-5e9e3b2e0abf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:00.336018 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9dc41c0a-1840-4e55-b2d4-5e9e3b2e0abf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:00.336458 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9dc41c0a-1840-4e55-b2d4-5e9e3b2e0abf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:00.337148 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9dc41c0a-1840-4e55-b2d4-5e9e3b2e0abf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:00.337634 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9dc41c0a-1840-4e55-b2d4-5e9e3b2e0abf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:00.338062 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9dc41c0a-1840-4e55-b2d4-5e9e3b2e0abf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:00.467993 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9dc41c0a-1840-4e55-b2d4-5e9e3b2e0abf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:00.475894 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9dc41c0a-1840-4e55-b2d4-5e9e3b2e0abf tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1363 microversion: 2.1 time: 0.151875 Aug 17 19:44:00.476455 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 313/613] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:00 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:00.534541 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-65c99eac-4724-476e-8ff3-ce72c87a1bc6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:00.535151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-65c99eac-4724-476e-8ff3-ce72c87a1bc6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:00.537442 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:44:00.542811 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-65c99eac-4724-476e-8ff3-ce72c87a1bc6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:00.543292 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-65c99eac-4724-476e-8ff3-ce72c87a1bc6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:00.543729 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-65c99eac-4724-476e-8ff3-ce72c87a1bc6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:00.544411 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-65c99eac-4724-476e-8ff3-ce72c87a1bc6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:00.544862 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-65c99eac-4724-476e-8ff3-ce72c87a1bc6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:00.545366 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-65c99eac-4724-476e-8ff3-ce72c87a1bc6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:00.563395 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=6 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:44:00.675700 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-65c99eac-4724-476e-8ff3-ce72c87a1bc6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:00.683109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-65c99eac-4724-476e-8ff3-ce72c87a1bc6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1691 microversion: 2.1 time: 0.152858 Aug 17 19:44:00.683679 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 301/614] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:00 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:01.496976 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-59bf9331-a3f7-403a-894b-92659aeec99f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:01.497631 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-59bf9331-a3f7-403a-894b-92659aeec99f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:01.500146 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=6 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:44:01.506212 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59bf9331-a3f7-403a-894b-92659aeec99f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:01.506705 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59bf9331-a3f7-403a-894b-92659aeec99f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:01.507144 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59bf9331-a3f7-403a-894b-92659aeec99f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:01.507844 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59bf9331-a3f7-403a-894b-92659aeec99f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:01.508295 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59bf9331-a3f7-403a-894b-92659aeec99f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:01.508721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59bf9331-a3f7-403a-894b-92659aeec99f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:01.528136 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-3303f546-4d76-4114-9be0-569d3c612d20 req-6ba964cd-812a-4bb4-8eb4-f8935f90def9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb", "name": "network-vif-deleted", "tag": "bf5dc59e-079d-4504-b553-f9c0418123e9"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:44:01.542231 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-3303f546-4d76-4114-9be0-569d3c612d20 req-6ba964cd-812a-4bb4-8eb4-f8935f90def9 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:01.542908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-3303f546-4d76-4114-9be0-569d3c612d20 req-6ba964cd-812a-4bb4-8eb4-f8935f90def9 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:01.543454 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-3303f546-4d76-4114-9be0-569d3c612d20 req-6ba964cd-812a-4bb4-8eb4-f8935f90def9 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:01.555648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-3303f546-4d76-4114-9be0-569d3c612d20 req-6ba964cd-812a-4bb4-8eb4-f8935f90def9 service nova] Creating event network-vif-deleted:bf5dc59e-079d-4504-b553-f9c0418123e9 for instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb on hv-cinder-85069 Aug 17 19:44:01.560537 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-3303f546-4d76-4114-9be0-569d3c612d20 req-6ba964cd-812a-4bb4-8eb4-f8935f90def9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036586 Aug 17 19:44:01.561125 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 302/615] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:01.670794 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-59bf9331-a3f7-403a-894b-92659aeec99f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:01.680031 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-59bf9331-a3f7-403a-894b-92659aeec99f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1363 microversion: 2.1 time: 0.186779 Aug 17 19:44:01.680613 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 314/616] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:01 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:01.704967 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-814b5fd8-5958-43fd-9797-bc86ce262dbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:01.705881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-814b5fd8-5958-43fd-9797-bc86ce262dbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:01.712628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-814b5fd8-5958-43fd-9797-bc86ce262dbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:01.713322 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-814b5fd8-5958-43fd-9797-bc86ce262dbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:01.713857 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-814b5fd8-5958-43fd-9797-bc86ce262dbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:01.714621 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-814b5fd8-5958-43fd-9797-bc86ce262dbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:01.715277 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-814b5fd8-5958-43fd-9797-bc86ce262dbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:01.715771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-814b5fd8-5958-43fd-9797-bc86ce262dbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:01.782342 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-814b5fd8-5958-43fd-9797-bc86ce262dbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:01.790100 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-814b5fd8-5958-43fd-9797-bc86ce262dbe tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 200 len: 1623 microversion: 2.1 time: 0.089609 Aug 17 19:44:01.790889 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 303/617] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:01 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 1623 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:02.704101 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-600a865c-e851-4730-982e-fe7cad384660 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:02.704746 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-600a865c-e851-4730-982e-fe7cad384660 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:02.711203 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-600a865c-e851-4730-982e-fe7cad384660 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:02.711694 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-600a865c-e851-4730-982e-fe7cad384660 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:02.712133 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-600a865c-e851-4730-982e-fe7cad384660 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:02.712825 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-600a865c-e851-4730-982e-fe7cad384660 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:02.713336 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-600a865c-e851-4730-982e-fe7cad384660 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:02.713765 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-600a865c-e851-4730-982e-fe7cad384660 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:02.812501 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-01603a9d-7261-49e6-b7c5-9d9d4944d89f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:02.813161 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-01603a9d-7261-49e6-b7c5-9d9d4944d89f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:02.819681 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-01603a9d-7261-49e6-b7c5-9d9d4944d89f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:02.820173 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-01603a9d-7261-49e6-b7c5-9d9d4944d89f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:02.820615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-01603a9d-7261-49e6-b7c5-9d9d4944d89f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:02.821352 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-01603a9d-7261-49e6-b7c5-9d9d4944d89f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:02.821816 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-01603a9d-7261-49e6-b7c5-9d9d4944d89f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:02.822240 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-01603a9d-7261-49e6-b7c5-9d9d4944d89f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:02.838567 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-01603a9d-7261-49e6-b7c5-9d9d4944d89f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] HTTP exception thrown: Instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb could not be found. Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-01603a9d-7261-49e6-b7c5-9d9d4944d89f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Request method failure captured: Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb HTTP/1.1 Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPcJwP4Aez04wsbq3OzdbRwjISIv1EoEdHV7G0Tv0BOZhNI_oAYMTTg8jUzGjV7x5yv1317qpWPwanXSDZ2HVJLkJtCsQ1rLkA0WpceWCoQN0d-VsE2IzoNSddrl80YveAfdY-iiqNNDgc8UfuxsbxO5OXL3zP9DrvJm955sOURGpQ Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: 25f3817d99d84da2b797215d23de887f Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:44:02.840212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:44:02.841771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25f3817d99d84da2b797215d23de887f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25f3817d99d84da2b797215d23de887f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25f3817d99d84da2b797215d23de887f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25f3817d99d84da2b797215d23de887f"}]}] Aug 17 19:44:02.841771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:44:02.841771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: 25f3817d99d84da2b797215d23de887f Aug 17 19:44:02.841771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:44:02.841771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-ServerRescueNegativeTestJSON-747820572-project Aug 17 19:44:02.841771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:44:02.841771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:44:02.841771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 608237a0c2704cd3bda98f3724db2528 Aug 17 19:44:02.841771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-ServerRescueNegativeTestJSON-747820572-project Aug 17 19:44:02.841771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:44:02.841771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb could not be found. Aug 17 19:44:02.841771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': 'be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb'} Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb could not be found. Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:44:02.842661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb could not be found. Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb could not be found. Aug 17 19:44:02.844024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:44:02.845149 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-01603a9d-7261-49e6-b7c5-9d9d4944d89f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Returning 404 to user: Instance be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:44:02.845149 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-01603a9d-7261-49e6-b7c5-9d9d4944d89f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb" status: 404 len: 111 microversion: 2.1 time: 0.033834 Aug 17 19:44:02.845149 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 304/618] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:02 2022] GET /compute/v2.1/servers/be7ddd20-3ca0-4a4a-b63e-3c7eb37989cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 19:44:02.849914 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-895a0704-f0be-4009-a345-db4d83dd41f3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '.version_select at 0x7f3689fdf3a0>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:02.867054 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-600a865c-e851-4730-982e-fe7cad384660 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:02.869769 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-895a0704-f0be-4009-a345-db4d83dd41f3 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862731004" status: 202 len: 0 microversion: 2.1 time: 0.023322 Aug 17 19:44:02.870345 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 305/619] 10.222.0.59 () {58 vars in 1221 bytes} [Wed Aug 17 19:44:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862731004 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:44:02.876194 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-600a865c-e851-4730-982e-fe7cad384660 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1549 microversion: 2.1 time: 0.176959 Aug 17 19:44:02.876893 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 315/620] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:02 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:02.896660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-9143a737-f666-4f5e-9425-2c268f0c4f21 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:02.897152 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9143a737-f666-4f5e-9425-2c268f0c4f21 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:02.902933 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9143a737-f666-4f5e-9425-2c268f0c4f21 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:02.903415 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9143a737-f666-4f5e-9425-2c268f0c4f21 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:02.903853 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9143a737-f666-4f5e-9425-2c268f0c4f21 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:02.904548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9143a737-f666-4f5e-9425-2c268f0c4f21 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:02.905003 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9143a737-f666-4f5e-9425-2c268f0c4f21 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:02.905528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9143a737-f666-4f5e-9425-2c268f0c4f21 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:03.026834 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-9143a737-f666-4f5e-9425-2c268f0c4f21 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.133860 Aug 17 19:44:03.027425 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 306/621] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 17 19:44:02 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:04.211018 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-18cf9214-82ea-413c-b0a2-1990443628e9 req-a8180c64-13ab-4c8e-88c8-aeeb248b52fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c8ca5b1-5ab2-48cf-824d-367bbac94eb0", "tag": "8d0240ee-c805-4cfa-aded-24a776b15f49"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:44:04.220670 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-18cf9214-82ea-413c-b0a2-1990443628e9 req-a8180c64-13ab-4c8e-88c8-aeeb248b52fc service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:04.221151 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-18cf9214-82ea-413c-b0a2-1990443628e9 req-a8180c64-13ab-4c8e-88c8-aeeb248b52fc service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:04.221606 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-18cf9214-82ea-413c-b0a2-1990443628e9 req-a8180c64-13ab-4c8e-88c8-aeeb248b52fc service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:04.232266 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-18cf9214-82ea-413c-b0a2-1990443628e9 req-a8180c64-13ab-4c8e-88c8-aeeb248b52fc service nova] Creating event network-changed:8d0240ee-c805-4cfa-aded-24a776b15f49 for instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 on hv-cinder-85069 Aug 17 19:44:04.237481 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-18cf9214-82ea-413c-b0a2-1990443628e9 req-a8180c64-13ab-4c8e-88c8-aeeb248b52fc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029981 Aug 17 19:44:04.239651 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 316/622] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:05.831351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-73775a1f-1096-4950-91cf-1e57572872df tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:05.831863 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-73775a1f-1096-4950-91cf-1e57572872df tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:05.837816 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-73775a1f-1096-4950-91cf-1e57572872df tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:05.838303 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-73775a1f-1096-4950-91cf-1e57572872df tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:05.838747 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-73775a1f-1096-4950-91cf-1e57572872df tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:05.839472 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-73775a1f-1096-4950-91cf-1e57572872df tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:05.839931 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-73775a1f-1096-4950-91cf-1e57572872df tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:05.840370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-73775a1f-1096-4950-91cf-1e57572872df tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:05.865630 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-73775a1f-1096-4950-91cf-1e57572872df tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Going to try to terminate instance {{(pid=132530) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:44:05.942737 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-73775a1f-1096-4950-91cf-1e57572872df tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "DELETE /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 204 len: 0 microversion: 2.1 time: 0.115779 Aug 17 19:44:05.943405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 307/623] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:44:05 2022] DELETE /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:44:05.953060 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b005525d-3e8f-40a4-a389-5372576c0ab6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:05.954359 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b005525d-3e8f-40a4-a389-5372576c0ab6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:05.961016 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b005525d-3e8f-40a4-a389-5372576c0ab6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:05.961561 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b005525d-3e8f-40a4-a389-5372576c0ab6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:05.961998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b005525d-3e8f-40a4-a389-5372576c0ab6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:05.962690 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b005525d-3e8f-40a4-a389-5372576c0ab6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:05.963144 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b005525d-3e8f-40a4-a389-5372576c0ab6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:05.963566 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b005525d-3e8f-40a4-a389-5372576c0ab6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:06.090753 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b005525d-3e8f-40a4-a389-5372576c0ab6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:06.099048 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b005525d-3e8f-40a4-a389-5372576c0ab6 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1508 microversion: 2.1 time: 0.151038 Aug 17 19:44:06.100242 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 317/624] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:05 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:07.120462 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-9b821bd4-493d-46f3-836e-a7de3d09b624 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:07.121141 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9b821bd4-493d-46f3-836e-a7de3d09b624 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:07.127965 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9b821bd4-493d-46f3-836e-a7de3d09b624 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:07.128446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9b821bd4-493d-46f3-836e-a7de3d09b624 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:07.128878 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9b821bd4-493d-46f3-836e-a7de3d09b624 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:07.129594 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9b821bd4-493d-46f3-836e-a7de3d09b624 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:07.130048 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9b821bd4-493d-46f3-836e-a7de3d09b624 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:07.130471 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9b821bd4-493d-46f3-836e-a7de3d09b624 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:07.256157 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9b821bd4-493d-46f3-836e-a7de3d09b624 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:07.263517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-9b821bd4-493d-46f3-836e-a7de3d09b624 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1508 microversion: 2.1 time: 0.147351 Aug 17 19:44:07.264072 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 308/625] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:07 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:08.284815 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3eabe4b3-b2a3-4a34-8b8a-4413bd172d5f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:08.285462 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3eabe4b3-b2a3-4a34-8b8a-4413bd172d5f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:08.292816 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3eabe4b3-b2a3-4a34-8b8a-4413bd172d5f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:08.293360 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3eabe4b3-b2a3-4a34-8b8a-4413bd172d5f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:08.294007 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3eabe4b3-b2a3-4a34-8b8a-4413bd172d5f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:08.294747 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3eabe4b3-b2a3-4a34-8b8a-4413bd172d5f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:08.295306 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3eabe4b3-b2a3-4a34-8b8a-4413bd172d5f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:08.295740 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3eabe4b3-b2a3-4a34-8b8a-4413bd172d5f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:08.428887 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3eabe4b3-b2a3-4a34-8b8a-4413bd172d5f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:08.436450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3eabe4b3-b2a3-4a34-8b8a-4413bd172d5f tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1508 microversion: 2.1 time: 0.156419 Aug 17 19:44:08.437596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 318/626] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:08 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:09.096555 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-36afba35-8fe9-46f0-ac6e-c8b554f21719 req-c601f3aa-bd2d-4620-9550-050455c8ded2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55783dca-99fe-42bc-9e65-2c65038d0902", "name": "network-vif-deleted", "tag": "31d9c9ee-a38e-4efd-a8af-b6989873b33d"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:44:09.108077 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-36afba35-8fe9-46f0-ac6e-c8b554f21719 req-c601f3aa-bd2d-4620-9550-050455c8ded2 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:09.108712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-36afba35-8fe9-46f0-ac6e-c8b554f21719 req-c601f3aa-bd2d-4620-9550-050455c8ded2 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:09.109243 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-36afba35-8fe9-46f0-ac6e-c8b554f21719 req-c601f3aa-bd2d-4620-9550-050455c8ded2 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:09.120820 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-36afba35-8fe9-46f0-ac6e-c8b554f21719 req-c601f3aa-bd2d-4620-9550-050455c8ded2 service nova] Creating event network-vif-deleted:31d9c9ee-a38e-4efd-a8af-b6989873b33d for instance 55783dca-99fe-42bc-9e65-2c65038d0902 on hv-cinder-85069 Aug 17 19:44:09.126348 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-36afba35-8fe9-46f0-ac6e-c8b554f21719 req-c601f3aa-bd2d-4620-9550-050455c8ded2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034050 Aug 17 19:44:09.126967 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 309/627] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:09.459105 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:09.460524 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:09.468065 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:09.468554 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:09.468985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:09.469805 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:09.470264 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:09.470681 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:09.488157 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:44:09.510101 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:09.510707 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:09.511250 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:09.511820 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.objects.instance [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lazy-loading 'fault' on Instance uuid 55783dca-99fe-42bc-9e65-2c65038d0902 {{(pid=132531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:44:09.742758 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:09.751035 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-7738e40f-6667-45a3-809b-361dd737ba6d tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 200 len: 1312 microversion: 2.1 time: 0.295283 Aug 17 19:44:09.751619 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 319/628] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:09 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 1312 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:10.772581 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-88ace04a-185d-44af-b85d-f021d3c23994 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:10.773309 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-88ace04a-185d-44af-b85d-f021d3c23994 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 55783dca-99fe-42bc-9e65-2c65038d0902] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:10.779331 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-88ace04a-185d-44af-b85d-f021d3c23994 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:10.779805 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-88ace04a-185d-44af-b85d-f021d3c23994 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:10.780236 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-88ace04a-185d-44af-b85d-f021d3c23994 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:10.780914 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-88ace04a-185d-44af-b85d-f021d3c23994 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:10.781434 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-88ace04a-185d-44af-b85d-f021d3c23994 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:10.781857 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-88ace04a-185d-44af-b85d-f021d3c23994 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:10.794557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-88ace04a-185d-44af-b85d-f021d3c23994 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] HTTP exception thrown: Instance 55783dca-99fe-42bc-9e65-2c65038d0902 could not be found. Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-88ace04a-185d-44af-b85d-f021d3c23994 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Request method failure captured: Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 HTTP/1.1 Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPcJwP4Aez04wsbq3OzdbRwjISIv1EoEdHV7G0Tv0BOZhNI_oAYMTTg8jUzGjV7x5yv1317qpWPwanXSDZ2HVJLkJtCsQ1rLkA0WpceWCoQN0d-VsE2IzoNSddrl80YveAfdY-iiqNNDgc8UfuxsbxO5OXL3zP9DrvJm955sOURGpQ Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: 25f3817d99d84da2b797215d23de887f Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:44:10.796121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:44:10.797953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25f3817d99d84da2b797215d23de887f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25f3817d99d84da2b797215d23de887f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25f3817d99d84da2b797215d23de887f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25f3817d99d84da2b797215d23de887f"}]}] Aug 17 19:44:10.797953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:44:10.797953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: 25f3817d99d84da2b797215d23de887f Aug 17 19:44:10.797953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:44:10.797953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-ServerRescueNegativeTestJSON-747820572-project Aug 17 19:44:10.797953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:44:10.797953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:44:10.797953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 608237a0c2704cd3bda98f3724db2528 Aug 17 19:44:10.797953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-ServerRescueNegativeTestJSON-747820572-project Aug 17 19:44:10.797953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:44:10.797953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 55783dca-99fe-42bc-9e65-2c65038d0902 could not be found. Aug 17 19:44:10.797953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '55783dca-99fe-42bc-9e65-2c65038d0902'} Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55783dca-99fe-42bc-9e65-2c65038d0902 could not be found. Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:44:10.798644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55783dca-99fe-42bc-9e65-2c65038d0902 could not be found. Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55783dca-99fe-42bc-9e65-2c65038d0902 could not be found. Aug 17 19:44:10.800088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:44:10.801579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-88ace04a-185d-44af-b85d-f021d3c23994 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Returning 404 to user: Instance 55783dca-99fe-42bc-9e65-2c65038d0902 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:44:10.801579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-88ace04a-185d-44af-b85d-f021d3c23994 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902" status: 404 len: 111 microversion: 2.1 time: 0.030198 Aug 17 19:44:10.801579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 310/629] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:10 2022] GET /compute/v2.1/servers/55783dca-99fe-42bc-9e65-2c65038d0902 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:44:10.806400 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-59b1b4d9-6465-45a3-acf1-f50da28eb2e8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:10.806900 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-59b1b4d9-6465-45a3-acf1-f50da28eb2e8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:10.813970 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1b4d9-6465-45a3-acf1-f50da28eb2e8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:10.814454 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1b4d9-6465-45a3-acf1-f50da28eb2e8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:10.814892 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1b4d9-6465-45a3-acf1-f50da28eb2e8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:10.815578 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1b4d9-6465-45a3-acf1-f50da28eb2e8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:10.816032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1b4d9-6465-45a3-acf1-f50da28eb2e8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:10.816457 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-59b1b4d9-6465-45a3-acf1-f50da28eb2e8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:10.840781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-59b1b4d9-6465-45a3-acf1-f50da28eb2e8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:44:10.912447 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-59b1b4d9-6465-45a3-acf1-f50da28eb2e8 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "DELETE /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 204 len: 0 microversion: 2.1 time: 0.109599 Aug 17 19:44:10.913251 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 320/630] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:44:10 2022] DELETE /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:44:10.923182 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1c5a8ddc-5033-4cea-b396-92622e80154a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:10.923974 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1c5a8ddc-5033-4cea-b396-92622e80154a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:10.930235 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1c5a8ddc-5033-4cea-b396-92622e80154a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:10.930718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1c5a8ddc-5033-4cea-b396-92622e80154a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:10.931156 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1c5a8ddc-5033-4cea-b396-92622e80154a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:10.931856 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1c5a8ddc-5033-4cea-b396-92622e80154a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:10.932312 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1c5a8ddc-5033-4cea-b396-92622e80154a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:10.932740 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1c5a8ddc-5033-4cea-b396-92622e80154a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:11.064190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1c5a8ddc-5033-4cea-b396-92622e80154a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:11.071579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1c5a8ddc-5033-4cea-b396-92622e80154a tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.153761 Aug 17 19:44:11.072138 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 311/631] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:10 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:11.329929 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a4cf81b8-5e4f-44e2-b067-089d143441dc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:11.330456 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a4cf81b8-5e4f-44e2-b067-089d143441dc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:11.336256 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4cf81b8-5e4f-44e2-b067-089d143441dc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:11.336729 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4cf81b8-5e4f-44e2-b067-089d143441dc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:11.337157 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4cf81b8-5e4f-44e2-b067-089d143441dc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:11.337850 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4cf81b8-5e4f-44e2-b067-089d143441dc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:11.338295 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4cf81b8-5e4f-44e2-b067-089d143441dc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:11.338711 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4cf81b8-5e4f-44e2-b067-089d143441dc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:11.364414 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a4cf81b8-5e4f-44e2-b067-089d143441dc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/ips" status: 200 len: 150 microversion: 2.20 time: 0.039568 Aug 17 19:44:11.364965 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 321/632] 10.222.0.59 () {60 vars in 1289 bytes} [Wed Aug 17 19:44:11 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:44:12.092598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a7b8cc0d-b783-428d-829f-3daa945218cb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:12.093231 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a7b8cc0d-b783-428d-829f-3daa945218cb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:12.099810 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a7b8cc0d-b783-428d-829f-3daa945218cb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:12.100294 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a7b8cc0d-b783-428d-829f-3daa945218cb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:12.100730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a7b8cc0d-b783-428d-829f-3daa945218cb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:12.101454 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a7b8cc0d-b783-428d-829f-3daa945218cb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:12.101909 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a7b8cc0d-b783-428d-829f-3daa945218cb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:12.102331 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a7b8cc0d-b783-428d-829f-3daa945218cb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:12.230623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a7b8cc0d-b783-428d-829f-3daa945218cb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:12.238564 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a7b8cc0d-b783-428d-829f-3daa945218cb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.149817 Aug 17 19:44:12.239125 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 312/633] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:12 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:13.259848 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-2010661a-69cf-4560-acfd-051d879360fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:13.260356 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-2010661a-69cf-4560-acfd-051d879360fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:13.262903 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:44:13.268684 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2010661a-69cf-4560-acfd-051d879360fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:13.269190 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2010661a-69cf-4560-acfd-051d879360fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:13.269652 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2010661a-69cf-4560-acfd-051d879360fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:13.270324 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2010661a-69cf-4560-acfd-051d879360fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:13.270775 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2010661a-69cf-4560-acfd-051d879360fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:13.271194 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2010661a-69cf-4560-acfd-051d879360fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:13.401820 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2010661a-69cf-4560-acfd-051d879360fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:13.409130 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-2010661a-69cf-4560-acfd-051d879360fb tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.153197 Aug 17 19:44:13.409719 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 322/634] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:13 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:14.429872 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-240c8a4d-6076-4f2c-b6af-1ec48b906700 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:14.430487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-240c8a4d-6076-4f2c-b6af-1ec48b906700 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:14.436869 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-240c8a4d-6076-4f2c-b6af-1ec48b906700 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:14.437969 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-240c8a4d-6076-4f2c-b6af-1ec48b906700 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:14.438411 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-240c8a4d-6076-4f2c-b6af-1ec48b906700 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:14.439098 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-240c8a4d-6076-4f2c-b6af-1ec48b906700 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:14.439557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-240c8a4d-6076-4f2c-b6af-1ec48b906700 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:14.439984 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-240c8a4d-6076-4f2c-b6af-1ec48b906700 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:14.570408 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-240c8a4d-6076-4f2c-b6af-1ec48b906700 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608237a0c2704cd3bda98f3724db2528', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25f3817d99d84da2b797215d23de887f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:14.578094 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-240c8a4d-6076-4f2c-b6af-1ec48b906700 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 200 len: 1523 microversion: 2.1 time: 0.152106 Aug 17 19:44:14.578651 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 313/635] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:14 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:14.819725 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c21a0f28-06c6-4bef-940d-a1ca2a2d1d13 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:44:14.820352 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-c21a0f28-06c6-4bef-940d-a1ca2a2d1d13 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:14.828088 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c21a0f28-06c6-4bef-940d-a1ca2a2d1d13 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:14.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c21a0f28-06c6-4bef-940d-a1ca2a2d1d13 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:14.829198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c21a0f28-06c6-4bef-940d-a1ca2a2d1d13 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:14.830108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c21a0f28-06c6-4bef-940d-a1ca2a2d1d13 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:14.830565 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c21a0f28-06c6-4bef-940d-a1ca2a2d1d13 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:14.830991 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c21a0f28-06c6-4bef-940d-a1ca2a2d1d13 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:14.860013 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.objects.instance [None req-c21a0f28-06c6-4bef-940d-a1ca2a2d1d13 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lazy-loading 'flavor' on Instance uuid 1cba8eae-5542-4c28-b8fa-79e93d2f0959 {{(pid=132531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:44:14.912591 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-b11558dc-ae1d-46ee-859a-72fbf4a2e6ab req-f12b71ac-6b87-4eb2-8dc9-1a69737a2dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "001bd590-d203-4670-aef3-300aae8d4c4f", "name": "network-vif-deleted", "tag": "00265e2e-29dc-406a-a2b2-cd2bb162da12"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:44:14.938398 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-b11558dc-ae1d-46ee-859a-72fbf4a2e6ab req-f12b71ac-6b87-4eb2-8dc9-1a69737a2dd0 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:14.942550 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-b11558dc-ae1d-46ee-859a-72fbf4a2e6ab req-f12b71ac-6b87-4eb2-8dc9-1a69737a2dd0 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:14.952407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-b11558dc-ae1d-46ee-859a-72fbf4a2e6ab req-f12b71ac-6b87-4eb2-8dc9-1a69737a2dd0 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:14.973070 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-b11558dc-ae1d-46ee-859a-72fbf4a2e6ab req-f12b71ac-6b87-4eb2-8dc9-1a69737a2dd0 service nova] Creating event network-vif-deleted:00265e2e-29dc-406a-a2b2-cd2bb162da12 for instance 001bd590-d203-4670-aef3-300aae8d4c4f on hv-cinder-85069 Aug 17 19:44:14.978353 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-b11558dc-ae1d-46ee-859a-72fbf4a2e6ab req-f12b71ac-6b87-4eb2-8dc9-1a69737a2dd0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070510 Aug 17 19:44:14.978944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 314/636] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:15.061391 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-c21a0f28-06c6-4bef-940d-a1ca2a2d1d13 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "POST /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/action" status: 202 len: 0 microversion: 2.20 time: 0.247692 Aug 17 19:44:15.061984 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 323/637] 10.222.0.59 () {62 vars in 1319 bytes} [Wed Aug 17 19:44:14 2022] POST /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:44:15.070516 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-df064cb7-2b53-4d20-a48c-fc39d640ab38 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:15.071211 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-df064cb7-2b53-4d20-a48c-fc39d640ab38 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:15.077711 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-df064cb7-2b53-4d20-a48c-fc39d640ab38 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:15.078681 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-df064cb7-2b53-4d20-a48c-fc39d640ab38 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:15.079115 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-df064cb7-2b53-4d20-a48c-fc39d640ab38 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:15.079799 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-df064cb7-2b53-4d20-a48c-fc39d640ab38 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:15.080255 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-df064cb7-2b53-4d20-a48c-fc39d640ab38 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:15.080706 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-df064cb7-2b53-4d20-a48c-fc39d640ab38 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:15.211313 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-df064cb7-2b53-4d20-a48c-fc39d640ab38 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:15.220071 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-df064cb7-2b53-4d20-a48c-fc39d640ab38 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:15.221600 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-df064cb7-2b53-4d20-a48c-fc39d640ab38 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:15.222769 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-df064cb7-2b53-4d20-a48c-fc39d640ab38 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1722 microversion: 2.20 time: 0.156380 Aug 17 19:44:15.223323 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 315/638] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:15 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:44:15.599187 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-64037d38-fc7a-4f2b-b1bb-c22d8de1ba56 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:15.599787 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-64037d38-fc7a-4f2b-b1bb-c22d8de1ba56 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] [instance: 001bd590-d203-4670-aef3-300aae8d4c4f] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:15.605963 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-64037d38-fc7a-4f2b-b1bb-c22d8de1ba56 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:15.606440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-64037d38-fc7a-4f2b-b1bb-c22d8de1ba56 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:15.606877 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-64037d38-fc7a-4f2b-b1bb-c22d8de1ba56 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:15.607556 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-64037d38-fc7a-4f2b-b1bb-c22d8de1ba56 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:15.608004 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-64037d38-fc7a-4f2b-b1bb-c22d8de1ba56 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:15.608453 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-64037d38-fc7a-4f2b-b1bb-c22d8de1ba56 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:15.621774 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-64037d38-fc7a-4f2b-b1bb-c22d8de1ba56 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] HTTP exception thrown: Instance 001bd590-d203-4670-aef3-300aae8d4c4f could not be found. Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-64037d38-fc7a-4f2b-b1bb-c22d8de1ba56 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Request method failure captured: Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f HTTP/1.1 Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPcJwP4Aez04wsbq3OzdbRwjISIv1EoEdHV7G0Tv0BOZhNI_oAYMTTg8jUzGjV7x5yv1317qpWPwanXSDZ2HVJLkJtCsQ1rLkA0WpceWCoQN0d-VsE2IzoNSddrl80YveAfdY-iiqNNDgc8UfuxsbxO5OXL3zP9DrvJm955sOURGpQ Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 25f3817d99d84da2b797215d23de887f Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:44:15.623404 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:44:15.625371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/25f3817d99d84da2b797215d23de887f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25f3817d99d84da2b797215d23de887f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_25f3817d99d84da2b797215d23de887f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/25f3817d99d84da2b797215d23de887f"}]}] Aug 17 19:44:15.625371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:44:15.625371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 25f3817d99d84da2b797215d23de887f Aug 17 19:44:15.625371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-747820572 Aug 17 19:44:15.625371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-ServerRescueNegativeTestJSON-747820572-project Aug 17 19:44:15.625371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:44:15.625371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:44:15.625371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 608237a0c2704cd3bda98f3724db2528 Aug 17 19:44:15.625371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-ServerRescueNegativeTestJSON-747820572-project Aug 17 19:44:15.625371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:44:15.625371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 001bd590-d203-4670-aef3-300aae8d4c4f could not be found. Aug 17 19:44:15.625371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '001bd590-d203-4670-aef3-300aae8d4c4f'} Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 001bd590-d203-4670-aef3-300aae8d4c4f could not be found. Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:44:15.626066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 001bd590-d203-4670-aef3-300aae8d4c4f could not be found. Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 001bd590-d203-4670-aef3-300aae8d4c4f could not be found. Aug 17 19:44:15.627460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:44:15.628692 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-64037d38-fc7a-4f2b-b1bb-c22d8de1ba56 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] Returning 404 to user: Instance 001bd590-d203-4670-aef3-300aae8d4c4f could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:44:15.628692 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-64037d38-fc7a-4f2b-b1bb-c22d8de1ba56 tempest-ServerRescueNegativeTestJSON-747820572 tempest-ServerRescueNegativeTestJSON-747820572-project] 10.222.0.59 "GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f" status: 404 len: 111 microversion: 2.1 time: 0.030066 Aug 17 19:44:15.628692 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 324/639] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:15 2022] GET /compute/v2.1/servers/001bd590-d203-4670-aef3-300aae8d4c4f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:44:16.246213 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1e652a69-b7d0-43dd-b732-7f6372c67cb3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:16.246820 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1e652a69-b7d0-43dd-b732-7f6372c67cb3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:16.253778 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1e652a69-b7d0-43dd-b732-7f6372c67cb3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:16.254255 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1e652a69-b7d0-43dd-b732-7f6372c67cb3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:16.254685 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1e652a69-b7d0-43dd-b732-7f6372c67cb3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:16.255365 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1e652a69-b7d0-43dd-b732-7f6372c67cb3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:16.255809 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1e652a69-b7d0-43dd-b732-7f6372c67cb3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:16.256226 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1e652a69-b7d0-43dd-b732-7f6372c67cb3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:16.448592 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1e652a69-b7d0-43dd-b732-7f6372c67cb3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:16.457269 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1e652a69-b7d0-43dd-b732-7f6372c67cb3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:16.458755 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1e652a69-b7d0-43dd-b732-7f6372c67cb3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:16.459894 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1e652a69-b7d0-43dd-b732-7f6372c67cb3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1722 microversion: 2.20 time: 0.217546 Aug 17 19:44:16.460445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 316/640] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:16 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:17.483768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-30b85725-ed77-4432-b660-c3f868047cd2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:17.485127 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-30b85725-ed77-4432-b660-c3f868047cd2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:17.491549 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-30b85725-ed77-4432-b660-c3f868047cd2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:17.492034 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-30b85725-ed77-4432-b660-c3f868047cd2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:17.492467 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-30b85725-ed77-4432-b660-c3f868047cd2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:17.493393 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-30b85725-ed77-4432-b660-c3f868047cd2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:17.493846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-30b85725-ed77-4432-b660-c3f868047cd2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:17.494271 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-30b85725-ed77-4432-b660-c3f868047cd2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:17.703599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-30b85725-ed77-4432-b660-c3f868047cd2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:17.711971 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-30b85725-ed77-4432-b660-c3f868047cd2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:17.713512 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-30b85725-ed77-4432-b660-c3f868047cd2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:17.714780 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-30b85725-ed77-4432-b660-c3f868047cd2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1722 microversion: 2.20 time: 0.235103 Aug 17 19:44:17.715714 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 325/641] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:17 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:18.738567 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-10c5c4a4-79f0-4f8d-90e6-3ad8f128d800 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:18.739340 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-10c5c4a4-79f0-4f8d-90e6-3ad8f128d800 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:18.746840 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-10c5c4a4-79f0-4f8d-90e6-3ad8f128d800 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:18.747257 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-10c5c4a4-79f0-4f8d-90e6-3ad8f128d800 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:18.747660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-10c5c4a4-79f0-4f8d-90e6-3ad8f128d800 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:18.748361 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-10c5c4a4-79f0-4f8d-90e6-3ad8f128d800 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:18.748812 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-10c5c4a4-79f0-4f8d-90e6-3ad8f128d800 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:18.749259 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-10c5c4a4-79f0-4f8d-90e6-3ad8f128d800 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:18.989077 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-10c5c4a4-79f0-4f8d-90e6-3ad8f128d800 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:18.997370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-10c5c4a4-79f0-4f8d-90e6-3ad8f128d800 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:18.999177 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-10c5c4a4-79f0-4f8d-90e6-3ad8f128d800 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:19.001472 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-10c5c4a4-79f0-4f8d-90e6-3ad8f128d800 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1722 microversion: 2.20 time: 0.267351 Aug 17 19:44:19.002305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 317/642] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:18 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:20.026956 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6ffb0341-43ac-44b4-85dc-21cea89ec7db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:20.027847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6ffb0341-43ac-44b4-85dc-21cea89ec7db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:20.034532 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ffb0341-43ac-44b4-85dc-21cea89ec7db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:20.035130 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ffb0341-43ac-44b4-85dc-21cea89ec7db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:20.035453 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ffb0341-43ac-44b4-85dc-21cea89ec7db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:20.036150 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ffb0341-43ac-44b4-85dc-21cea89ec7db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:20.036669 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ffb0341-43ac-44b4-85dc-21cea89ec7db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:20.037042 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ffb0341-43ac-44b4-85dc-21cea89ec7db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:20.165097 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6ffb0341-43ac-44b4-85dc-21cea89ec7db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:20.173607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6ffb0341-43ac-44b4-85dc-21cea89ec7db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:20.175118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6ffb0341-43ac-44b4-85dc-21cea89ec7db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:20.176283 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6ffb0341-43ac-44b4-85dc-21cea89ec7db tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1722 microversion: 2.20 time: 0.153430 Aug 17 19:44:20.176826 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 326/643] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:20 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:21.199210 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3a3bf54c-a975-40eb-9c8d-7e780e13dd39 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:21.199989 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3a3bf54c-a975-40eb-9c8d-7e780e13dd39 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:21.202508 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:44:21.208320 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a3bf54c-a975-40eb-9c8d-7e780e13dd39 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:21.208798 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a3bf54c-a975-40eb-9c8d-7e780e13dd39 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:21.209255 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a3bf54c-a975-40eb-9c8d-7e780e13dd39 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:21.209944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a3bf54c-a975-40eb-9c8d-7e780e13dd39 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:21.210396 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a3bf54c-a975-40eb-9c8d-7e780e13dd39 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:21.210818 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3a3bf54c-a975-40eb-9c8d-7e780e13dd39 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:21.343818 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3a3bf54c-a975-40eb-9c8d-7e780e13dd39 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:21.352176 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3a3bf54c-a975-40eb-9c8d-7e780e13dd39 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:21.353710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3a3bf54c-a975-40eb-9c8d-7e780e13dd39 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:21.354868 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3a3bf54c-a975-40eb-9c8d-7e780e13dd39 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1722 microversion: 2.20 time: 0.159682 Aug 17 19:44:21.355421 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 318/644] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:21 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:44:21.430782 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-39c037ad-564b-4884-b87a-6a3990f33345 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] Calling method '.version_select at 0x7f3689eb8160>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:21.478658 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-39c037ad-564b-4884-b87a-6a3990f33345 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/28d88936-2afc-4c27-b155-8d633a414177" status: 200 len: 351 microversion: 2.1 time: 0.051689 Aug 17 19:44:21.479209 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 327/645] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:44:21 2022] GET /compute/v2.1/os-volumes/28d88936-2afc-4c27-b155-8d633a414177 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:22.378302 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-25182d5e-2faf-4af8-87b1-4a2153679ced tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:22.378938 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-25182d5e-2faf-4af8-87b1-4a2153679ced tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:22.385272 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25182d5e-2faf-4af8-87b1-4a2153679ced tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:22.385757 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25182d5e-2faf-4af8-87b1-4a2153679ced tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:22.386189 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25182d5e-2faf-4af8-87b1-4a2153679ced tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:22.386879 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25182d5e-2faf-4af8-87b1-4a2153679ced tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:22.387336 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25182d5e-2faf-4af8-87b1-4a2153679ced tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:22.387757 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25182d5e-2faf-4af8-87b1-4a2153679ced tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:22.513751 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-25182d5e-2faf-4af8-87b1-4a2153679ced tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:22.515882 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:44:22.523078 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-25182d5e-2faf-4af8-87b1-4a2153679ced tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:22.524552 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-25182d5e-2faf-4af8-87b1-4a2153679ced tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:22.525721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-25182d5e-2faf-4af8-87b1-4a2153679ced tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1722 microversion: 2.20 time: 0.151922 Aug 17 19:44:22.526276 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 319/646] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:22 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:22.804908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3c8c18f5-96e8-40b8-a37e-057a0a04dc21 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] Calling method '.version_select at 0x7f368a080820>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:22.849879 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3c8c18f5-96e8-40b8-a37e-057a0a04dc21 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/0dcc8f4a-37b3-48ea-bd3f-644558a2fb3b" status: 200 len: 349 microversion: 2.1 time: 0.049246 Aug 17 19:44:22.850431 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 328/647] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:44:22 2022] GET /compute/v2.1/os-volumes/0dcc8f4a-37b3-48ea-bd3f-644558a2fb3b => generated 349 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:23.549363 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8e7641bc-b3a6-40f4-a087-253dad75cf90 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:23.549977 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-8e7641bc-b3a6-40f4-a087-253dad75cf90 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:23.557430 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e7641bc-b3a6-40f4-a087-253dad75cf90 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:23.557916 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e7641bc-b3a6-40f4-a087-253dad75cf90 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:23.558355 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e7641bc-b3a6-40f4-a087-253dad75cf90 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:23.559043 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e7641bc-b3a6-40f4-a087-253dad75cf90 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:23.559502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e7641bc-b3a6-40f4-a087-253dad75cf90 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:23.559958 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e7641bc-b3a6-40f4-a087-253dad75cf90 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:23.688764 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8e7641bc-b3a6-40f4-a087-253dad75cf90 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:23.696592 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8e7641bc-b3a6-40f4-a087-253dad75cf90 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:23.698129 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8e7641bc-b3a6-40f4-a087-253dad75cf90 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:23.699288 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8e7641bc-b3a6-40f4-a087-253dad75cf90 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1722 microversion: 2.20 time: 0.154370 Aug 17 19:44:23.700101 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 320/648] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:23 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:24.183849 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-92f60d19-3b91-4ac6-9403-3b572b8cdfe6 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] Calling method '.version_select at 0x7f3689e6db80>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:24.230186 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-92f60d19-3b91-4ac6-9403-3b572b8cdfe6 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/8e77221b-650a-462f-b7d0-7296856d52fd" status: 200 len: 351 microversion: 2.1 time: 0.050662 Aug 17 19:44:24.230741 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 329/649] 10.222.0.59 () {58 vars in 1245 bytes} [Wed Aug 17 19:44:24 2022] GET /compute/v2.1/os-volumes/8e77221b-650a-462f-b7d0-7296856d52fd => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:24.243610 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-fc049f3a-1eff-4523-8e91-6aac8b844c0c tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] Calling method '.version_select at 0x7f368a01aee0>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:24.323163 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-fc049f3a-1eff-4523-8e91-6aac8b844c0c tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.083219 Aug 17 19:44:24.323758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 321/650] 10.222.0.59 () {58 vars in 1134 bytes} [Wed Aug 17 19:44:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:24.337624 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f13650a7-046d-41fc-8b33-60126cf66700 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] Calling method '.version_select at 0x7f3689fd4ee0>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:24.418744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f13650a7-046d-41fc-8b33-60126cf66700 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084829 Aug 17 19:44:24.419311 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 330/651] 10.222.0.59 () {58 vars in 1149 bytes} [Wed Aug 17 19:44:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:24.432731 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b9c56135-7d51-44a7-813a-11920bd21223 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] Calling method '.version_select at 0x7f3689fdfe50>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:24.513168 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b9c56135-7d51-44a7-813a-11920bd21223 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084112 Aug 17 19:44:24.513785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 322/652] 10.222.0.59 () {58 vars in 1134 bytes} [Wed Aug 17 19:44:24 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:24.526216 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5c3649f9-4614-49fd-af39-89e75999d672 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] Calling method '.version_select at 0x7f3689ed5310>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:24.606024 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5c3649f9-4614-49fd-af39-89e75999d672 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.083487 Aug 17 19:44:24.606617 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 331/653] 10.222.0.59 () {58 vars in 1167 bytes} [Wed Aug 17 19:44:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:24.620740 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-123d06bd-9439-4adb-8ee8-65310d2b357e tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] Calling method '.version_select at 0x7f368a05eb80>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:24.700757 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-123d06bd-9439-4adb-8ee8-65310d2b357e tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084201 Aug 17 19:44:24.701353 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 323/654] 10.222.0.59 () {58 vars in 1170 bytes} [Wed Aug 17 19:44:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:44:24.714922 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-db84e839-4e76-4d9f-aa14-80ad8c5ed2c4 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] Calling method '.version_select at 0x7f368a080820>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:24.722675 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-14db0541-cdb2-48ff-9c9c-5b4b2d744c40 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:24.723623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-14db0541-cdb2-48ff-9c9c-5b4b2d744c40 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:24.729646 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-14db0541-cdb2-48ff-9c9c-5b4b2d744c40 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:24.730134 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-14db0541-cdb2-48ff-9c9c-5b4b2d744c40 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:24.730575 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-14db0541-cdb2-48ff-9c9c-5b4b2d744c40 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:24.731270 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-14db0541-cdb2-48ff-9c9c-5b4b2d744c40 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:24.731727 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-14db0541-cdb2-48ff-9c9c-5b4b2d744c40 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:24.732155 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-14db0541-cdb2-48ff-9c9c-5b4b2d744c40 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:24.795732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-db84e839-4e76-4d9f-aa14-80ad8c5ed2c4 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084472 Aug 17 19:44:24.796522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 332/655] 10.222.0.59 () {58 vars in 1155 bytes} [Wed Aug 17 19:44:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:24.808960 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-702d24cc-203d-4c20-9ec1-d37a7d242baf tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] Calling method '.version_select at 0x7f3689fd5d30>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:24.862626 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-14db0541-cdb2-48ff-9c9c-5b4b2d744c40 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:24.870553 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-14db0541-cdb2-48ff-9c9c-5b4b2d744c40 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:24.872071 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-14db0541-cdb2-48ff-9c9c-5b4b2d744c40 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:24.873449 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-14db0541-cdb2-48ff-9c9c-5b4b2d744c40 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1722 microversion: 2.20 time: 0.155054 Aug 17 19:44:24.874002 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 324/656] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:24 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:44:24.889417 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-702d24cc-203d-4c20-9ec1-d37a7d242baf tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.084207 Aug 17 19:44:24.889979 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 333/657] 10.222.0.59 () {58 vars in 1188 bytes} [Wed Aug 17 19:44:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:44:24.902956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2509f2b4-4bed-44e3-9837-2083212f2eb1 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] Calling method '.version_select at 0x7f3689fdfaf0>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:24.985427 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2509f2b4-4bed-44e3-9837-2083212f2eb1 tempest-VolumesTestJSON-278805642 tempest-VolumesTestJSON-278805642-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086150 Aug 17 19:44:24.985990 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 325/658] 10.222.0.59 () {58 vars in 1155 bytes} [Wed Aug 17 19:44:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:25.896953 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5dc9fa64-b2f5-464d-888a-8e9675013503 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:25.897605 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5dc9fa64-b2f5-464d-888a-8e9675013503 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:25.903540 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5dc9fa64-b2f5-464d-888a-8e9675013503 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:25.904013 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5dc9fa64-b2f5-464d-888a-8e9675013503 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:25.904442 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5dc9fa64-b2f5-464d-888a-8e9675013503 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:25.905118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5dc9fa64-b2f5-464d-888a-8e9675013503 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:25.905584 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5dc9fa64-b2f5-464d-888a-8e9675013503 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:25.906004 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5dc9fa64-b2f5-464d-888a-8e9675013503 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:26.036723 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5dc9fa64-b2f5-464d-888a-8e9675013503 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:26.044580 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5dc9fa64-b2f5-464d-888a-8e9675013503 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:26.046098 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5dc9fa64-b2f5-464d-888a-8e9675013503 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:26.047232 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5dc9fa64-b2f5-464d-888a-8e9675013503 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1743 microversion: 2.20 time: 0.154633 Aug 17 19:44:26.048452 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 334/659] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:25 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:27.071948 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-9ea423d7-99a9-4bdf-af97-54069e5bf469 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:27.072589 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9ea423d7-99a9-4bdf-af97-54069e5bf469 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:27.080194 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9ea423d7-99a9-4bdf-af97-54069e5bf469 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:27.080680 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9ea423d7-99a9-4bdf-af97-54069e5bf469 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:27.081117 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9ea423d7-99a9-4bdf-af97-54069e5bf469 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:27.081836 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9ea423d7-99a9-4bdf-af97-54069e5bf469 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:27.082293 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9ea423d7-99a9-4bdf-af97-54069e5bf469 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:27.082717 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9ea423d7-99a9-4bdf-af97-54069e5bf469 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:27.213113 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9ea423d7-99a9-4bdf-af97-54069e5bf469 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:27.221530 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9ea423d7-99a9-4bdf-af97-54069e5bf469 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:27.223038 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9ea423d7-99a9-4bdf-af97-54069e5bf469 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:27.224190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-9ea423d7-99a9-4bdf-af97-54069e5bf469 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1743 microversion: 2.20 time: 0.156801 Aug 17 19:44:27.224752 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 326/660] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:27 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:28.253911 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6ecb4019-7360-4195-ac89-60a833c46286 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:28.254783 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6ecb4019-7360-4195-ac89-60a833c46286 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:28.261413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ecb4019-7360-4195-ac89-60a833c46286 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:28.261894 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ecb4019-7360-4195-ac89-60a833c46286 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:28.262450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ecb4019-7360-4195-ac89-60a833c46286 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:28.263276 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ecb4019-7360-4195-ac89-60a833c46286 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:28.263724 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ecb4019-7360-4195-ac89-60a833c46286 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:28.264148 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ecb4019-7360-4195-ac89-60a833c46286 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:28.412257 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6ecb4019-7360-4195-ac89-60a833c46286 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:28.423080 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6ecb4019-7360-4195-ac89-60a833c46286 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:28.425853 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6ecb4019-7360-4195-ac89-60a833c46286 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:28.427237 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6ecb4019-7360-4195-ac89-60a833c46286 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1738 microversion: 2.20 time: 0.181725 Aug 17 19:44:28.427933 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 335/661] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:28 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:44:29.458750 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-952991b6-bfb9-4ec6-bfe6-7cdfea00eed6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:29.459359 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-952991b6-bfb9-4ec6-bfe6-7cdfea00eed6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:29.466962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-952991b6-bfb9-4ec6-bfe6-7cdfea00eed6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:29.467758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-952991b6-bfb9-4ec6-bfe6-7cdfea00eed6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:29.468540 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-952991b6-bfb9-4ec6-bfe6-7cdfea00eed6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:29.469504 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-952991b6-bfb9-4ec6-bfe6-7cdfea00eed6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:29.470939 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-952991b6-bfb9-4ec6-bfe6-7cdfea00eed6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:29.471553 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-952991b6-bfb9-4ec6-bfe6-7cdfea00eed6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:29.650459 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-952991b6-bfb9-4ec6-bfe6-7cdfea00eed6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:29.661409 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-952991b6-bfb9-4ec6-bfe6-7cdfea00eed6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:29.665345 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-952991b6-bfb9-4ec6-bfe6-7cdfea00eed6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:29.666925 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-952991b6-bfb9-4ec6-bfe6-7cdfea00eed6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1738 microversion: 2.20 time: 0.212041 Aug 17 19:44:29.676630 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 327/662] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:29 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:30.690851 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0f18992f-a8bd-490f-b48e-64fe8bf0b07c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:30.691460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0f18992f-a8bd-490f-b48e-64fe8bf0b07c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:30.707014 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f18992f-a8bd-490f-b48e-64fe8bf0b07c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:30.707516 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f18992f-a8bd-490f-b48e-64fe8bf0b07c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:30.708158 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f18992f-a8bd-490f-b48e-64fe8bf0b07c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:30.709027 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f18992f-a8bd-490f-b48e-64fe8bf0b07c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:30.709663 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f18992f-a8bd-490f-b48e-64fe8bf0b07c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:30.710243 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0f18992f-a8bd-490f-b48e-64fe8bf0b07c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:30.891500 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0f18992f-a8bd-490f-b48e-64fe8bf0b07c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:30.905499 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0f18992f-a8bd-490f-b48e-64fe8bf0b07c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:30.908706 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0f18992f-a8bd-490f-b48e-64fe8bf0b07c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:30.910846 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0f18992f-a8bd-490f-b48e-64fe8bf0b07c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1738 microversion: 2.20 time: 0.224503 Aug 17 19:44:30.912047 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 336/663] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:30 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:31.290549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-70737a37-c8ff-47dd-98c4-570d04138bab req-c373bc1a-1fdc-4f59-8ca9-d30724ac74be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cba8eae-5542-4c28-b8fa-79e93d2f0959", "name": "network-vif-plugged", "status": "completed", "tag": "d7eda5e9-6550-4d73-bb9c-c6d74429a2d5"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:44:31.304454 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-70737a37-c8ff-47dd-98c4-570d04138bab req-c373bc1a-1fdc-4f59-8ca9-d30724ac74be service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:31.305105 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-70737a37-c8ff-47dd-98c4-570d04138bab req-c373bc1a-1fdc-4f59-8ca9-d30724ac74be service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:31.305824 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-70737a37-c8ff-47dd-98c4-570d04138bab req-c373bc1a-1fdc-4f59-8ca9-d30724ac74be service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:31.317339 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-70737a37-c8ff-47dd-98c4-570d04138bab req-c373bc1a-1fdc-4f59-8ca9-d30724ac74be service nova] Creating event network-vif-plugged:d7eda5e9-6550-4d73-bb9c-c6d74429a2d5 for instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 on hv-cinder-85069 Aug 17 19:44:31.323079 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-70737a37-c8ff-47dd-98c4-570d04138bab req-c373bc1a-1fdc-4f59-8ca9-d30724ac74be service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035996 Aug 17 19:44:31.324016 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 328/664] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:31.936047 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-66e8fba8-97d3-40b7-a638-9dffcdf0a452 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:31.936662 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-66e8fba8-97d3-40b7-a638-9dffcdf0a452 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:31.948416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-66e8fba8-97d3-40b7-a638-9dffcdf0a452 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:31.948919 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-66e8fba8-97d3-40b7-a638-9dffcdf0a452 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:31.949386 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-66e8fba8-97d3-40b7-a638-9dffcdf0a452 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:31.950359 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-66e8fba8-97d3-40b7-a638-9dffcdf0a452 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:31.950812 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-66e8fba8-97d3-40b7-a638-9dffcdf0a452 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:31.951237 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-66e8fba8-97d3-40b7-a638-9dffcdf0a452 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:32.133638 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-66e8fba8-97d3-40b7-a638-9dffcdf0a452 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:32.143459 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-66e8fba8-97d3-40b7-a638-9dffcdf0a452 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:32.145727 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-66e8fba8-97d3-40b7-a638-9dffcdf0a452 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:32.146896 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-66e8fba8-97d3-40b7-a638-9dffcdf0a452 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1738 microversion: 2.20 time: 0.214712 Aug 17 19:44:32.147812 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 337/665] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:31 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:33.172394 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-97e56faa-ba63-4cc7-a70e-1a36f38b3b7c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:33.173917 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-97e56faa-ba63-4cc7-a70e-1a36f38b3b7c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:33.180778 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-97e56faa-ba63-4cc7-a70e-1a36f38b3b7c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:33.181603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-97e56faa-ba63-4cc7-a70e-1a36f38b3b7c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:33.182220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-97e56faa-ba63-4cc7-a70e-1a36f38b3b7c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:33.183162 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-97e56faa-ba63-4cc7-a70e-1a36f38b3b7c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:33.183850 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-97e56faa-ba63-4cc7-a70e-1a36f38b3b7c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:33.187913 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-97e56faa-ba63-4cc7-a70e-1a36f38b3b7c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:33.389733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-97e56faa-ba63-4cc7-a70e-1a36f38b3b7c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:33.404434 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-97e56faa-ba63-4cc7-a70e-1a36f38b3b7c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:33.406120 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-97e56faa-ba63-4cc7-a70e-1a36f38b3b7c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:33.407787 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-97e56faa-ba63-4cc7-a70e-1a36f38b3b7c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1738 microversion: 2.20 time: 0.240956 Aug 17 19:44:33.408898 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 329/666] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:33 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:34.434888 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8ac578ea-9c5d-4674-a0ba-83742b0c0daf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:34.435628 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-8ac578ea-9c5d-4674-a0ba-83742b0c0daf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:34.443175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8ac578ea-9c5d-4674-a0ba-83742b0c0daf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:34.443665 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8ac578ea-9c5d-4674-a0ba-83742b0c0daf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:34.444093 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8ac578ea-9c5d-4674-a0ba-83742b0c0daf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:34.444901 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8ac578ea-9c5d-4674-a0ba-83742b0c0daf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:34.445380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8ac578ea-9c5d-4674-a0ba-83742b0c0daf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:34.445868 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8ac578ea-9c5d-4674-a0ba-83742b0c0daf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:34.652757 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8ac578ea-9c5d-4674-a0ba-83742b0c0daf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:34.663602 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8ac578ea-9c5d-4674-a0ba-83742b0c0daf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:34.665726 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8ac578ea-9c5d-4674-a0ba-83742b0c0daf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:34.666857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8ac578ea-9c5d-4674-a0ba-83742b0c0daf tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1738 microversion: 2.20 time: 0.237038 Aug 17 19:44:34.667441 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 338/667] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:34 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:35.695124 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-297c01c1-adcc-4098-a146-4fee8d667e65 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:35.696444 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-297c01c1-adcc-4098-a146-4fee8d667e65 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:35.703325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-297c01c1-adcc-4098-a146-4fee8d667e65 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:35.704926 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-297c01c1-adcc-4098-a146-4fee8d667e65 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:35.705759 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-297c01c1-adcc-4098-a146-4fee8d667e65 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:35.707011 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-297c01c1-adcc-4098-a146-4fee8d667e65 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:35.707529 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-297c01c1-adcc-4098-a146-4fee8d667e65 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:35.708050 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-297c01c1-adcc-4098-a146-4fee8d667e65 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:35.879811 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-297c01c1-adcc-4098-a146-4fee8d667e65 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:35.893383 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-297c01c1-adcc-4098-a146-4fee8d667e65 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:35.896433 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-297c01c1-adcc-4098-a146-4fee8d667e65 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:35.897845 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-297c01c1-adcc-4098-a146-4fee8d667e65 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1738 microversion: 2.20 time: 0.209108 Aug 17 19:44:35.909303 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 330/668] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:35 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:36.924465 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-558eebfa-af73-49bd-8f15-fb6569daf6e0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:36.925076 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-558eebfa-af73-49bd-8f15-fb6569daf6e0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:36.940185 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-558eebfa-af73-49bd-8f15-fb6569daf6e0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:36.940842 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-558eebfa-af73-49bd-8f15-fb6569daf6e0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:36.941457 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-558eebfa-af73-49bd-8f15-fb6569daf6e0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:36.942810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-558eebfa-af73-49bd-8f15-fb6569daf6e0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:36.943426 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-558eebfa-af73-49bd-8f15-fb6569daf6e0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:36.944018 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-558eebfa-af73-49bd-8f15-fb6569daf6e0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:37.110390 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-558eebfa-af73-49bd-8f15-fb6569daf6e0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:37.122040 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-558eebfa-af73-49bd-8f15-fb6569daf6e0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:37.123708 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-558eebfa-af73-49bd-8f15-fb6569daf6e0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:37.125892 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-558eebfa-af73-49bd-8f15-fb6569daf6e0 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1738 microversion: 2.20 time: 0.205330 Aug 17 19:44:37.126636 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 339/669] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:36 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:38.150959 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-7927e586-005d-4cbf-b2da-3f821268b88a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:38.152122 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-7927e586-005d-4cbf-b2da-3f821268b88a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:38.158799 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7927e586-005d-4cbf-b2da-3f821268b88a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:38.159272 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7927e586-005d-4cbf-b2da-3f821268b88a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:38.159910 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7927e586-005d-4cbf-b2da-3f821268b88a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:38.160745 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7927e586-005d-4cbf-b2da-3f821268b88a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:38.161374 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7927e586-005d-4cbf-b2da-3f821268b88a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:38.161795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7927e586-005d-4cbf-b2da-3f821268b88a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:38.305167 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-7927e586-005d-4cbf-b2da-3f821268b88a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:38.313806 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-7927e586-005d-4cbf-b2da-3f821268b88a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:38.315308 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-7927e586-005d-4cbf-b2da-3f821268b88a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:38.316465 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-7927e586-005d-4cbf-b2da-3f821268b88a tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1738 microversion: 2.20 time: 0.169366 Aug 17 19:44:38.317067 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 331/670] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:38 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:39.339783 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-21855e0f-471d-4c45-8dec-de94a3264218 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:39.340403 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-21855e0f-471d-4c45-8dec-de94a3264218 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:39.346870 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-21855e0f-471d-4c45-8dec-de94a3264218 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:39.347437 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-21855e0f-471d-4c45-8dec-de94a3264218 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:39.347920 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-21855e0f-471d-4c45-8dec-de94a3264218 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:39.348674 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-21855e0f-471d-4c45-8dec-de94a3264218 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:39.349230 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-21855e0f-471d-4c45-8dec-de94a3264218 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:39.349692 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-21855e0f-471d-4c45-8dec-de94a3264218 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:39.352535 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:44:39.500582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-21855e0f-471d-4c45-8dec-de94a3264218 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:39.510110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-21855e0f-471d-4c45-8dec-de94a3264218 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:39.512259 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-21855e0f-471d-4c45-8dec-de94a3264218 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:39.513543 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-21855e0f-471d-4c45-8dec-de94a3264218 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1720 microversion: 2.20 time: 0.177603 Aug 17 19:44:39.514202 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 340/671] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:39 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1720 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:40.539358 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e59d3808-784d-4053-b12f-9a9c1f3d85b7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:40.539968 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e59d3808-784d-4053-b12f-9a9c1f3d85b7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:40.546324 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e59d3808-784d-4053-b12f-9a9c1f3d85b7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:40.546803 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e59d3808-784d-4053-b12f-9a9c1f3d85b7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:40.547236 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e59d3808-784d-4053-b12f-9a9c1f3d85b7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:40.547926 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e59d3808-784d-4053-b12f-9a9c1f3d85b7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:40.548381 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e59d3808-784d-4053-b12f-9a9c1f3d85b7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:40.548807 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e59d3808-784d-4053-b12f-9a9c1f3d85b7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:40.678856 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e59d3808-784d-4053-b12f-9a9c1f3d85b7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:40.686834 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e59d3808-784d-4053-b12f-9a9c1f3d85b7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:40.688401 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e59d3808-784d-4053-b12f-9a9c1f3d85b7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:40.689583 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e59d3808-784d-4053-b12f-9a9c1f3d85b7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1720 microversion: 2.20 time: 0.154186 Aug 17 19:44:40.690139 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 332/672] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:40 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:41.712873 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-80eb93b7-d1fe-48cb-a18e-312af951c59f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:41.713513 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-80eb93b7-d1fe-48cb-a18e-312af951c59f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:41.721010 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-80eb93b7-d1fe-48cb-a18e-312af951c59f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:41.721544 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-80eb93b7-d1fe-48cb-a18e-312af951c59f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:41.721982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-80eb93b7-d1fe-48cb-a18e-312af951c59f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:41.722675 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-80eb93b7-d1fe-48cb-a18e-312af951c59f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:41.723128 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-80eb93b7-d1fe-48cb-a18e-312af951c59f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:41.723553 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-80eb93b7-d1fe-48cb-a18e-312af951c59f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:41.850734 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-80eb93b7-d1fe-48cb-a18e-312af951c59f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:41.858590 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-80eb93b7-d1fe-48cb-a18e-312af951c59f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:41.860696 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-80eb93b7-d1fe-48cb-a18e-312af951c59f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:41.861857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-80eb93b7-d1fe-48cb-a18e-312af951c59f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1663 microversion: 2.20 time: 0.152841 Aug 17 19:44:41.862405 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 341/673] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:41 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:44:41.883750 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-365a6481-968c-40a1-a25a-98e8603d4251 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66760aab-a4d5-413a-aa7e-d6300f74e8b5"}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:44:41.886247 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-365a6481-968c-40a1-a25a-98e8603d4251 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:41.892704 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-365a6481-968c-40a1-a25a-98e8603d4251 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:41.893189 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-365a6481-968c-40a1-a25a-98e8603d4251 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:41.893658 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-365a6481-968c-40a1-a25a-98e8603d4251 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:41.894348 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-365a6481-968c-40a1-a25a-98e8603d4251 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:41.894833 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-365a6481-968c-40a1-a25a-98e8603d4251 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:41.895260 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-365a6481-968c-40a1-a25a-98e8603d4251 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:42.175459 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-365a6481-968c-40a1-a25a-98e8603d4251 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "POST /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295755 Aug 17 19:44:42.176338 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 333/674] 10.222.0.59 () {62 vars in 1364 bytes} [Wed Aug 17 19:44:41 2022] POST /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 19:44:42.302971 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-7c9cd37b-f831-473c-99e2-67cb9cbc2dd3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:42.303620 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-7c9cd37b-f831-473c-99e2-67cb9cbc2dd3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:42.309652 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7c9cd37b-f831-473c-99e2-67cb9cbc2dd3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:42.310428 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7c9cd37b-f831-473c-99e2-67cb9cbc2dd3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:42.310862 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7c9cd37b-f831-473c-99e2-67cb9cbc2dd3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:42.311554 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7c9cd37b-f831-473c-99e2-67cb9cbc2dd3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:42.312006 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7c9cd37b-f831-473c-99e2-67cb9cbc2dd3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:42.312426 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7c9cd37b-f831-473c-99e2-67cb9cbc2dd3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:42.606224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-7c9cd37b-f831-473c-99e2-67cb9cbc2dd3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/os-volume_attachments/66760aab-a4d5-413a-aa7e-d6300f74e8b5" status: 202 len: 0 microversion: 2.20 time: 0.307212 Aug 17 19:44:42.606796 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 342/675] 10.222.0.59 () {60 vars in 1457 bytes} [Wed Aug 17 19:44:42 2022] DELETE /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/os-volume_attachments/66760aab-a4d5-413a-aa7e-d6300f74e8b5 => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:44:42.665746 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f6cff13e-424e-48d7-9214-fcdbcc54dd36 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:44:42.666338 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f6cff13e-424e-48d7-9214-fcdbcc54dd36 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:42.673561 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6cff13e-424e-48d7-9214-fcdbcc54dd36 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:42.674043 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6cff13e-424e-48d7-9214-fcdbcc54dd36 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:42.674474 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6cff13e-424e-48d7-9214-fcdbcc54dd36 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:42.675159 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6cff13e-424e-48d7-9214-fcdbcc54dd36 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:42.675638 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6cff13e-424e-48d7-9214-fcdbcc54dd36 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:42.676060 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6cff13e-424e-48d7-9214-fcdbcc54dd36 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:42.704292 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f6cff13e-424e-48d7-9214-fcdbcc54dd36 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132530) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 19:44:42.766961 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f6cff13e-424e-48d7-9214-fcdbcc54dd36 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "POST /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/action" status: 202 len: 0 microversion: 2.20 time: 0.105102 Aug 17 19:44:42.767587 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 334/676] 10.222.0.59 () {62 vars in 1319 bytes} [Wed Aug 17 19:44:42 2022] POST /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:44:42.776043 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-fd3cbac1-ed73-4f1c-a7d1-e19129e32580 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:42.776975 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-fd3cbac1-ed73-4f1c-a7d1-e19129e32580 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:42.784674 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fd3cbac1-ed73-4f1c-a7d1-e19129e32580 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:42.785163 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fd3cbac1-ed73-4f1c-a7d1-e19129e32580 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:42.785640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fd3cbac1-ed73-4f1c-a7d1-e19129e32580 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:42.786379 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fd3cbac1-ed73-4f1c-a7d1-e19129e32580 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:42.786863 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fd3cbac1-ed73-4f1c-a7d1-e19129e32580 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:42.787582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fd3cbac1-ed73-4f1c-a7d1-e19129e32580 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:42.949999 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-fd3cbac1-ed73-4f1c-a7d1-e19129e32580 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:42.959478 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-fd3cbac1-ed73-4f1c-a7d1-e19129e32580 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:42.961200 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-fd3cbac1-ed73-4f1c-a7d1-e19129e32580 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:42.962369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-fd3cbac1-ed73-4f1c-a7d1-e19129e32580 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1671 microversion: 2.20 time: 0.190565 Aug 17 19:44:42.962917 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 343/677] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:42 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1671 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:43.421625 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-a071a89c-a28a-4d5e-8659-b3f6cc83dfca req-5d28fdd8-f7ee-44dd-8b5c-a8ad982e7062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cba8eae-5542-4c28-b8fa-79e93d2f0959", "name": "network-vif-unplugged", "status": "completed", "tag": "d7eda5e9-6550-4d73-bb9c-c6d74429a2d5"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:44:43.433557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-a071a89c-a28a-4d5e-8659-b3f6cc83dfca req-5d28fdd8-f7ee-44dd-8b5c-a8ad982e7062 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:43.433996 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-a071a89c-a28a-4d5e-8659-b3f6cc83dfca req-5d28fdd8-f7ee-44dd-8b5c-a8ad982e7062 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:43.434484 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-a071a89c-a28a-4d5e-8659-b3f6cc83dfca req-5d28fdd8-f7ee-44dd-8b5c-a8ad982e7062 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:43.446987 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.compute.server_external_events [req-a071a89c-a28a-4d5e-8659-b3f6cc83dfca req-5d28fdd8-f7ee-44dd-8b5c-a8ad982e7062 service nova] Unable to find a host for instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959. Dropping event network-vif-unplugged {{(pid=132530) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 17 19:44:43.448100 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-a071a89c-a28a-4d5e-8659-b3f6cc83dfca req-5d28fdd8-f7ee-44dd-8b5c-a8ad982e7062 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.186435 Aug 17 19:44:43.448902 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 335/678] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 188 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 17 19:44:43.986811 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6c1a80f2-265a-4a68-8fc8-f9a11b5a24f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:43.987426 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6c1a80f2-265a-4a68-8fc8-f9a11b5a24f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:43.989707 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=30 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:44:43.994992 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6c1a80f2-265a-4a68-8fc8-f9a11b5a24f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:43.995479 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6c1a80f2-265a-4a68-8fc8-f9a11b5a24f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:43.995914 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6c1a80f2-265a-4a68-8fc8-f9a11b5a24f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:43.996602 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6c1a80f2-265a-4a68-8fc8-f9a11b5a24f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:43.997063 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6c1a80f2-265a-4a68-8fc8-f9a11b5a24f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:43.997513 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6c1a80f2-265a-4a68-8fc8-f9a11b5a24f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:44.133713 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6c1a80f2-265a-4a68-8fc8-f9a11b5a24f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:44.141854 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6c1a80f2-265a-4a68-8fc8-f9a11b5a24f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:44.143367 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6c1a80f2-265a-4a68-8fc8-f9a11b5a24f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:44.144594 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6c1a80f2-265a-4a68-8fc8-f9a11b5a24f3 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.162348 Aug 17 19:44:44.145155 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 344/679] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:43 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:45.171270 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ec1f120d-befe-4f91-ac87-57d59b7efc5c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:45.172727 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ec1f120d-befe-4f91-ac87-57d59b7efc5c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:45.181980 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec1f120d-befe-4f91-ac87-57d59b7efc5c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:45.182791 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec1f120d-befe-4f91-ac87-57d59b7efc5c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:45.183498 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec1f120d-befe-4f91-ac87-57d59b7efc5c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:45.184568 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec1f120d-befe-4f91-ac87-57d59b7efc5c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:45.185309 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec1f120d-befe-4f91-ac87-57d59b7efc5c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:45.185952 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec1f120d-befe-4f91-ac87-57d59b7efc5c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:45.394073 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ec1f120d-befe-4f91-ac87-57d59b7efc5c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:45.404364 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ec1f120d-befe-4f91-ac87-57d59b7efc5c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:45.407319 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ec1f120d-befe-4f91-ac87-57d59b7efc5c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:45.408922 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ec1f120d-befe-4f91-ac87-57d59b7efc5c tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.241597 Aug 17 19:44:45.410250 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 336/680] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:45 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:46.433533 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e15173a1-6385-4b8a-b2cd-c5cdaeb0898d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:46.434139 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e15173a1-6385-4b8a-b2cd-c5cdaeb0898d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:46.440561 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e15173a1-6385-4b8a-b2cd-c5cdaeb0898d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:46.441149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e15173a1-6385-4b8a-b2cd-c5cdaeb0898d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:46.441617 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e15173a1-6385-4b8a-b2cd-c5cdaeb0898d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:46.442363 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e15173a1-6385-4b8a-b2cd-c5cdaeb0898d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:46.442880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e15173a1-6385-4b8a-b2cd-c5cdaeb0898d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:46.443644 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e15173a1-6385-4b8a-b2cd-c5cdaeb0898d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:46.591101 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e15173a1-6385-4b8a-b2cd-c5cdaeb0898d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:46.601486 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e15173a1-6385-4b8a-b2cd-c5cdaeb0898d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:46.604750 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e15173a1-6385-4b8a-b2cd-c5cdaeb0898d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:46.606345 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e15173a1-6385-4b8a-b2cd-c5cdaeb0898d tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.176564 Aug 17 19:44:46.608096 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 345/681] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:46 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:47.632088 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a102e6b1-b3c6-40e1-82a4-b62e64e164f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:47.632776 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a102e6b1-b3c6-40e1-82a4-b62e64e164f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:47.639798 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a102e6b1-b3c6-40e1-82a4-b62e64e164f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:47.641016 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a102e6b1-b3c6-40e1-82a4-b62e64e164f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:47.641728 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a102e6b1-b3c6-40e1-82a4-b62e64e164f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:47.642720 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a102e6b1-b3c6-40e1-82a4-b62e64e164f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:47.643386 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a102e6b1-b3c6-40e1-82a4-b62e64e164f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:47.643926 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a102e6b1-b3c6-40e1-82a4-b62e64e164f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:47.800849 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a102e6b1-b3c6-40e1-82a4-b62e64e164f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:47.810223 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a102e6b1-b3c6-40e1-82a4-b62e64e164f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:47.811736 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a102e6b1-b3c6-40e1-82a4-b62e64e164f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:47.813671 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a102e6b1-b3c6-40e1-82a4-b62e64e164f5 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.185592 Aug 17 19:44:47.814220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 337/682] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:47 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:47.972525 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-aac006ce-18f6-4083-9856-7cf1c7fdfff8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:47.973037 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-aac006ce-18f6-4083-9856-7cf1c7fdfff8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:47.979087 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-aac006ce-18f6-4083-9856-7cf1c7fdfff8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:47.979502 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-aac006ce-18f6-4083-9856-7cf1c7fdfff8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:47.979934 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-aac006ce-18f6-4083-9856-7cf1c7fdfff8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:47.980630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-aac006ce-18f6-4083-9856-7cf1c7fdfff8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:47.981071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-aac006ce-18f6-4083-9856-7cf1c7fdfff8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:47.981524 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-aac006ce-18f6-4083-9856-7cf1c7fdfff8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:48.006317 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-aac006ce-18f6-4083-9856-7cf1c7fdfff8 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/ips" status: 200 len: 146 microversion: 2.1 time: 0.149945 Aug 17 19:44:48.006967 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 346/683] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 17 19:44:47 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/ips => generated 146 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:48.838371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6971cb24-7963-4cad-b05c-f95bcdd7446f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:48.839546 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-6971cb24-7963-4cad-b05c-f95bcdd7446f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:48.845926 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6971cb24-7963-4cad-b05c-f95bcdd7446f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:48.846407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6971cb24-7963-4cad-b05c-f95bcdd7446f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:48.846836 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6971cb24-7963-4cad-b05c-f95bcdd7446f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:48.847659 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6971cb24-7963-4cad-b05c-f95bcdd7446f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:48.848113 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6971cb24-7963-4cad-b05c-f95bcdd7446f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:48.848528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6971cb24-7963-4cad-b05c-f95bcdd7446f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:48.852506 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:44:49.011871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6971cb24-7963-4cad-b05c-f95bcdd7446f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:49.021460 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6971cb24-7963-4cad-b05c-f95bcdd7446f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:49.023220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6971cb24-7963-4cad-b05c-f95bcdd7446f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:49.024733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-6971cb24-7963-4cad-b05c-f95bcdd7446f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.190385 Aug 17 19:44:49.025498 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 338/684] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:48 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:49.413496 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-75b3b017-bea1-41c2-8876-574203a96c00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ae0a7ba-a11b-470d-b7d6-a40066d68ba4"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:44:49.416024 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-75b3b017-bea1-41c2-8876-574203a96c00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:49.423495 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-75b3b017-bea1-41c2-8876-574203a96c00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:49.424199 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-75b3b017-bea1-41c2-8876-574203a96c00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:49.424706 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-75b3b017-bea1-41c2-8876-574203a96c00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:49.425975 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-75b3b017-bea1-41c2-8876-574203a96c00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:49.426705 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-75b3b017-bea1-41c2-8876-574203a96c00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:49.427678 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-75b3b017-bea1-41c2-8876-574203a96c00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:50.058341 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b2fb6d20-77a4-4e15-9ecc-be59b731aaca tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:50.058960 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b2fb6d20-77a4-4e15-9ecc-be59b731aaca tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:50.065428 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b2fb6d20-77a4-4e15-9ecc-be59b731aaca tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:50.065918 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b2fb6d20-77a4-4e15-9ecc-be59b731aaca tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:50.066353 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b2fb6d20-77a4-4e15-9ecc-be59b731aaca tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:50.067049 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b2fb6d20-77a4-4e15-9ecc-be59b731aaca tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:50.067502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b2fb6d20-77a4-4e15-9ecc-be59b731aaca tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:50.067932 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b2fb6d20-77a4-4e15-9ecc-be59b731aaca tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:50.266142 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b2fb6d20-77a4-4e15-9ecc-be59b731aaca tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:50.277533 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b2fb6d20-77a4-4e15-9ecc-be59b731aaca tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:50.279395 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b2fb6d20-77a4-4e15-9ecc-be59b731aaca tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:50.280676 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b2fb6d20-77a4-4e15-9ecc-be59b731aaca tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.232226 Aug 17 19:44:50.282092 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 339/685] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:50 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:44:51.305485 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-abcd3dca-724a-4cc0-b24c-3e4a134234df tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:51.306353 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-abcd3dca-724a-4cc0-b24c-3e4a134234df tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:51.308986 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:44:51.315681 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-abcd3dca-724a-4cc0-b24c-3e4a134234df tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:51.316271 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-abcd3dca-724a-4cc0-b24c-3e4a134234df tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:51.316988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-abcd3dca-724a-4cc0-b24c-3e4a134234df tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:51.317970 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-abcd3dca-724a-4cc0-b24c-3e4a134234df tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:51.318788 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-abcd3dca-724a-4cc0-b24c-3e4a134234df tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:51.319562 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-abcd3dca-724a-4cc0-b24c-3e4a134234df tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:51.463951 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-abcd3dca-724a-4cc0-b24c-3e4a134234df tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:51.472709 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-abcd3dca-724a-4cc0-b24c-3e4a134234df tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:51.474255 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-abcd3dca-724a-4cc0-b24c-3e4a134234df tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:51.475425 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-abcd3dca-724a-4cc0-b24c-3e4a134234df tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.174044 Aug 17 19:44:51.476022 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 340/686] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:51 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:44:52.500497 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e85f0eeb-4761-4aa0-8855-352c3bc6c709 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:52.501139 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e85f0eeb-4761-4aa0-8855-352c3bc6c709 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:52.507606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e85f0eeb-4761-4aa0-8855-352c3bc6c709 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:52.508096 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e85f0eeb-4761-4aa0-8855-352c3bc6c709 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:52.508533 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e85f0eeb-4761-4aa0-8855-352c3bc6c709 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:52.509238 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e85f0eeb-4761-4aa0-8855-352c3bc6c709 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:52.509694 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e85f0eeb-4761-4aa0-8855-352c3bc6c709 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:52.510117 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e85f0eeb-4761-4aa0-8855-352c3bc6c709 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:52.635075 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e85f0eeb-4761-4aa0-8855-352c3bc6c709 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:52.642847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e85f0eeb-4761-4aa0-8855-352c3bc6c709 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:52.644340 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e85f0eeb-4761-4aa0-8855-352c3bc6c709 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:52.645488 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e85f0eeb-4761-4aa0-8855-352c3bc6c709 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.149526 Aug 17 19:44:52.646040 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 341/687] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:52 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:44:53.526540 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-75b3b017-bea1-41c2-8876-574203a96c00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "POST /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.116934 Aug 17 19:44:53.527211 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 347/688] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:44:49 2022] POST /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments => generated 194 bytes in 4118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:53.667747 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-76a1660a-e025-48ef-bad5-3212ab700e7b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:53.668364 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-76a1660a-e025-48ef-bad5-3212ab700e7b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:53.675313 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76a1660a-e025-48ef-bad5-3212ab700e7b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:53.675806 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76a1660a-e025-48ef-bad5-3212ab700e7b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:53.676244 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76a1660a-e025-48ef-bad5-3212ab700e7b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:53.677125 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76a1660a-e025-48ef-bad5-3212ab700e7b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:53.677620 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76a1660a-e025-48ef-bad5-3212ab700e7b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:53.678053 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76a1660a-e025-48ef-bad5-3212ab700e7b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:53.811664 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-76a1660a-e025-48ef-bad5-3212ab700e7b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:53.819826 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-76a1660a-e025-48ef-bad5-3212ab700e7b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:53.821353 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-76a1660a-e025-48ef-bad5-3212ab700e7b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:53.822539 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-76a1660a-e025-48ef-bad5-3212ab700e7b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.158597 Aug 17 19:44:53.823106 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 342/689] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:53 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:54.848496 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1ad3ff37-b3ce-47c4-8199-0c124fb8bcab tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:54.849420 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1ad3ff37-b3ce-47c4-8199-0c124fb8bcab tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:54.855641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1ad3ff37-b3ce-47c4-8199-0c124fb8bcab tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:54.856121 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1ad3ff37-b3ce-47c4-8199-0c124fb8bcab tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:54.856555 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1ad3ff37-b3ce-47c4-8199-0c124fb8bcab tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:54.857250 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1ad3ff37-b3ce-47c4-8199-0c124fb8bcab tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:54.857702 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1ad3ff37-b3ce-47c4-8199-0c124fb8bcab tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:54.858120 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1ad3ff37-b3ce-47c4-8199-0c124fb8bcab tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:54.986455 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1ad3ff37-b3ce-47c4-8199-0c124fb8bcab tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:54.994258 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1ad3ff37-b3ce-47c4-8199-0c124fb8bcab tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:54.995772 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1ad3ff37-b3ce-47c4-8199-0c124fb8bcab tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:54.996902 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1ad3ff37-b3ce-47c4-8199-0c124fb8bcab tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.154019 Aug 17 19:44:54.997494 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 348/690] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:54 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:55.859801 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-fa837cfa-eddc-451c-b319-82e799006270 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:44:55.860457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-fa837cfa-eddc-451c-b319-82e799006270 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:55.866550 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa837cfa-eddc-451c-b319-82e799006270 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:55.867046 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa837cfa-eddc-451c-b319-82e799006270 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:55.867473 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa837cfa-eddc-451c-b319-82e799006270 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:55.868196 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa837cfa-eddc-451c-b319-82e799006270 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:55.868654 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa837cfa-eddc-451c-b319-82e799006270 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:55.869078 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa837cfa-eddc-451c-b319-82e799006270 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:55.890804 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-fa837cfa-eddc-451c-b319-82e799006270 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lazy-loading 'flavor' on Instance uuid 76985445-294d-45f5-9f95-40951eed1555 {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:44:55.965771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-fa837cfa-eddc-451c-b319-82e799006270 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "POST /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555/action" status: 202 len: 0 microversion: 2.1 time: 0.110315 Aug 17 19:44:55.966348 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 343/691] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:44:55 2022] POST /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:44:55.975099 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-339879df-82f0-4d6a-b5e5-564e6367e622 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:55.975753 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-339879df-82f0-4d6a-b5e5-564e6367e622 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:55.982520 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-339879df-82f0-4d6a-b5e5-564e6367e622 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:55.983141 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-339879df-82f0-4d6a-b5e5-564e6367e622 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:55.984372 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-339879df-82f0-4d6a-b5e5-564e6367e622 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:55.985280 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-339879df-82f0-4d6a-b5e5-564e6367e622 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:55.985877 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-339879df-82f0-4d6a-b5e5-564e6367e622 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:55.986323 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-339879df-82f0-4d6a-b5e5-564e6367e622 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:56.020423 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e2142d36-99fc-43f7-90a3-69e9464b9386 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:56.021113 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e2142d36-99fc-43f7-90a3-69e9464b9386 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:56.027303 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e2142d36-99fc-43f7-90a3-69e9464b9386 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:56.027787 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e2142d36-99fc-43f7-90a3-69e9464b9386 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:56.028214 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e2142d36-99fc-43f7-90a3-69e9464b9386 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:56.028900 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e2142d36-99fc-43f7-90a3-69e9464b9386 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:56.029374 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e2142d36-99fc-43f7-90a3-69e9464b9386 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:56.029797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e2142d36-99fc-43f7-90a3-69e9464b9386 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:56.398951 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-339879df-82f0-4d6a-b5e5-564e6367e622 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:56.406518 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-339879df-82f0-4d6a-b5e5-564e6367e622 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.435306 Aug 17 19:44:56.407084 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 349/692] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:55 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:56.426555 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e2142d36-99fc-43f7-90a3-69e9464b9386 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:56.434572 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e2142d36-99fc-43f7-90a3-69e9464b9386 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:56.436071 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e2142d36-99fc-43f7-90a3-69e9464b9386 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:56.437850 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e2142d36-99fc-43f7-90a3-69e9464b9386 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.421117 Aug 17 19:44:56.438408 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 344/693] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:56 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:44:57.370491 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-d3e4c7f8-814c-4a99-aea8-f4a1416e70c0 req-d873709b-66a3-4266-bb19-cc723c8daac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cba8eae-5542-4c28-b8fa-79e93d2f0959", "name": "network-vif-plugged", "status": "completed", "tag": "d7eda5e9-6550-4d73-bb9c-c6d74429a2d5"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:44:57.382691 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-d3e4c7f8-814c-4a99-aea8-f4a1416e70c0 req-d873709b-66a3-4266-bb19-cc723c8daac7 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:57.382691 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-d3e4c7f8-814c-4a99-aea8-f4a1416e70c0 req-d873709b-66a3-4266-bb19-cc723c8daac7 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:57.388078 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-d3e4c7f8-814c-4a99-aea8-f4a1416e70c0 req-d873709b-66a3-4266-bb19-cc723c8daac7 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:57.400768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-d3e4c7f8-814c-4a99-aea8-f4a1416e70c0 req-d873709b-66a3-4266-bb19-cc723c8daac7 service nova] Creating event network-vif-plugged:d7eda5e9-6550-4d73-bb9c-c6d74429a2d5 for instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 on hv-cinder-85069 Aug 17 19:44:57.405600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-d3e4c7f8-814c-4a99-aea8-f4a1416e70c0 req-d873709b-66a3-4266-bb19-cc723c8daac7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038779 Aug 17 19:44:57.406258 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 350/694] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:44:57.428223 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-39f56d55-0cc2-49c9-b960-4ceefdae6421 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:57.428933 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-39f56d55-0cc2-49c9-b960-4ceefdae6421 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:57.435461 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-39f56d55-0cc2-49c9-b960-4ceefdae6421 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:57.435941 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-39f56d55-0cc2-49c9-b960-4ceefdae6421 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:57.436369 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-39f56d55-0cc2-49c9-b960-4ceefdae6421 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:57.437620 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-39f56d55-0cc2-49c9-b960-4ceefdae6421 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:57.438070 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-39f56d55-0cc2-49c9-b960-4ceefdae6421 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:57.438487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-39f56d55-0cc2-49c9-b960-4ceefdae6421 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:57.461589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6d7b52ca-7c76-411b-adc7-e22bdbbecbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:57.462388 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6d7b52ca-7c76-411b-adc7-e22bdbbecbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:57.469331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6d7b52ca-7c76-411b-adc7-e22bdbbecbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:57.469931 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6d7b52ca-7c76-411b-adc7-e22bdbbecbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:57.470457 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6d7b52ca-7c76-411b-adc7-e22bdbbecbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:57.471426 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6d7b52ca-7c76-411b-adc7-e22bdbbecbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:57.471882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6d7b52ca-7c76-411b-adc7-e22bdbbecbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:57.472342 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6d7b52ca-7c76-411b-adc7-e22bdbbecbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:57.650819 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-39f56d55-0cc2-49c9-b960-4ceefdae6421 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:57.654803 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6d7b52ca-7c76-411b-adc7-e22bdbbecbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:57.658683 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-39f56d55-0cc2-49c9-b960-4ceefdae6421 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.234811 Aug 17 19:44:57.659330 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 345/695] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:57 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:57.662932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6d7b52ca-7c76-411b-adc7-e22bdbbecbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:57.664494 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6d7b52ca-7c76-411b-adc7-e22bdbbecbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:57.665757 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6d7b52ca-7c76-411b-adc7-e22bdbbecbb7 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.208709 Aug 17 19:44:57.666400 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 351/696] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:57 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:44:58.680019 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e4dc26af-dc7f-4d19-8cf8-28914175f282 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:58.680628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e4dc26af-dc7f-4d19-8cf8-28914175f282 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:58.687160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e4dc26af-dc7f-4d19-8cf8-28914175f282 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:58.687643 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e4dc26af-dc7f-4d19-8cf8-28914175f282 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:58.688077 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e4dc26af-dc7f-4d19-8cf8-28914175f282 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:58.688763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e4dc26af-dc7f-4d19-8cf8-28914175f282 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:58.688970 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-2484e3e4-413b-48ea-9556-a804bf66ea49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:58.689394 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e4dc26af-dc7f-4d19-8cf8-28914175f282 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:58.689626 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-2484e3e4-413b-48ea-9556-a804bf66ea49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:58.689732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e4dc26af-dc7f-4d19-8cf8-28914175f282 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:58.695755 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2484e3e4-413b-48ea-9556-a804bf66ea49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:58.696236 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2484e3e4-413b-48ea-9556-a804bf66ea49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:58.696670 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2484e3e4-413b-48ea-9556-a804bf66ea49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:58.697387 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2484e3e4-413b-48ea-9556-a804bf66ea49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:58.697843 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2484e3e4-413b-48ea-9556-a804bf66ea49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:58.698268 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2484e3e4-413b-48ea-9556-a804bf66ea49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:58.886761 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e4dc26af-dc7f-4d19-8cf8-28914175f282 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:58.891322 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2484e3e4-413b-48ea-9556-a804bf66ea49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:58.894806 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e4dc26af-dc7f-4d19-8cf8-28914175f282 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.218650 Aug 17 19:44:58.895624 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 346/697] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:58 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:44:58.899142 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2484e3e4-413b-48ea-9556-a804bf66ea49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:58.900649 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2484e3e4-413b-48ea-9556-a804bf66ea49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:44:58.901820 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-2484e3e4-413b-48ea-9556-a804bf66ea49 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.216644 Aug 17 19:44:58.902371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 352/698] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:58 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:44:59.930212 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-2651558b-4193-4430-b44c-209dbae06c26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:59.931414 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-2651558b-4193-4430-b44c-209dbae06c26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:59.933958 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-310fc7de-a34c-4d75-814b-39b272dec90f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:44:59.935285 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-310fc7de-a34c-4d75-814b-39b272dec90f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:44:59.939889 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2651558b-4193-4430-b44c-209dbae06c26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:59.940459 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2651558b-4193-4430-b44c-209dbae06c26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:59.940991 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2651558b-4193-4430-b44c-209dbae06c26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:59.941822 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2651558b-4193-4430-b44c-209dbae06c26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:59.942347 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-310fc7de-a34c-4d75-814b-39b272dec90f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:59.942475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2651558b-4193-4430-b44c-209dbae06c26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:59.943114 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-310fc7de-a34c-4d75-814b-39b272dec90f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:59.943241 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2651558b-4193-4430-b44c-209dbae06c26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:59.943898 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-310fc7de-a34c-4d75-814b-39b272dec90f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:44:59.944900 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-310fc7de-a34c-4d75-814b-39b272dec90f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:44:59.945454 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-310fc7de-a34c-4d75-814b-39b272dec90f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:44:59.945899 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-310fc7de-a34c-4d75-814b-39b272dec90f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:00.163093 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2651558b-4193-4430-b44c-209dbae06c26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:00.166594 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:45:00.167353 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-310fc7de-a34c-4d75-814b-39b272dec90f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:00.172070 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-2651558b-4193-4430-b44c-209dbae06c26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.247802 Aug 17 19:45:00.172636 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 353/699] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:44:59 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:00.176430 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-310fc7de-a34c-4d75-814b-39b272dec90f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:00.178040 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-310fc7de-a34c-4d75-814b-39b272dec90f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:00.179292 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-310fc7de-a34c-4d75-814b-39b272dec90f tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1729 microversion: 2.20 time: 0.258020 Aug 17 19:45:00.179914 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 347/700] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:44:59 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1729 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:45:01.038678 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-815da81a-e438-4c8d-9942-0cf68900aa41 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:01.040791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-815da81a-e438-4c8d-9942-0cf68900aa41 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:01.047914 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-815da81a-e438-4c8d-9942-0cf68900aa41 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:01.048402 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-815da81a-e438-4c8d-9942-0cf68900aa41 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:01.048843 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-815da81a-e438-4c8d-9942-0cf68900aa41 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:01.049576 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-815da81a-e438-4c8d-9942-0cf68900aa41 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:01.050036 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-815da81a-e438-4c8d-9942-0cf68900aa41 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:01.050461 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-815da81a-e438-4c8d-9942-0cf68900aa41 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:01.082288 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-815da81a-e438-4c8d-9942-0cf68900aa41 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048013 Aug 17 19:45:01.082836 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 354/701] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:45:01 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:45:01.093335 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-25805e55-5a76-4b04-b9ed-1d8042debc06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:01.093833 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-25805e55-5a76-4b04-b9ed-1d8042debc06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:01.100122 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25805e55-5a76-4b04-b9ed-1d8042debc06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:01.100605 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25805e55-5a76-4b04-b9ed-1d8042debc06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:01.101045 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25805e55-5a76-4b04-b9ed-1d8042debc06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:01.101774 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25805e55-5a76-4b04-b9ed-1d8042debc06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:01.102232 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25805e55-5a76-4b04-b9ed-1d8042debc06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:01.102689 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-25805e55-5a76-4b04-b9ed-1d8042debc06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:01.131155 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-25805e55-5a76-4b04-b9ed-1d8042debc06 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments/8ae0a7ba-a11b-470d-b7d6-a40066d68ba4" status: 200 len: 194 microversion: 2.1 time: 0.041818 Aug 17 19:45:01.131722 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 348/702] 10.222.0.59 () {58 vars in 1413 bytes} [Wed Aug 17 19:45:01 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments/8ae0a7ba-a11b-470d-b7d6-a40066d68ba4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:45:01.192997 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a4a66c0f-7b2e-4228-9042-ff91e284df83 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:01.193637 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a4a66c0f-7b2e-4228-9042-ff91e284df83 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:01.199800 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4a66c0f-7b2e-4228-9042-ff91e284df83 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:01.200270 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4a66c0f-7b2e-4228-9042-ff91e284df83 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:01.200694 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4a66c0f-7b2e-4228-9042-ff91e284df83 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:01.201393 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4a66c0f-7b2e-4228-9042-ff91e284df83 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:01.201955 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4a66c0f-7b2e-4228-9042-ff91e284df83 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:01.202372 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4a66c0f-7b2e-4228-9042-ff91e284df83 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:01.204014 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-38dbdbc9-dad0-46ab-a035-278728849c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:01.204879 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-38dbdbc9-dad0-46ab-a035-278728849c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:01.211810 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-38dbdbc9-dad0-46ab-a035-278728849c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:01.212373 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-38dbdbc9-dad0-46ab-a035-278728849c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:01.213039 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-38dbdbc9-dad0-46ab-a035-278728849c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:01.213996 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-38dbdbc9-dad0-46ab-a035-278728849c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:01.214792 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-38dbdbc9-dad0-46ab-a035-278728849c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:01.215681 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-38dbdbc9-dad0-46ab-a035-278728849c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:01.424718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-38dbdbc9-dad0-46ab-a035-278728849c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:01.429055 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a4a66c0f-7b2e-4228-9042-ff91e284df83 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:01.432844 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-38dbdbc9-dad0-46ab-a035-278728849c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:01.434375 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-38dbdbc9-dad0-46ab-a035-278728849c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:01.435731 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-38dbdbc9-dad0-46ab-a035-278728849c43 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1716 microversion: 2.20 time: 0.237449 Aug 17 19:45:01.436447 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 349/703] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:45:01 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1716 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 19:45:01.437067 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a4a66c0f-7b2e-4228-9042-ff91e284df83 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.247813 Aug 17 19:45:01.437684 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 355/704] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:01 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:02.458564 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3681d90a-b258-4a77-b583-c1bcd17cf9b0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:02.459186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3681d90a-b258-4a77-b583-c1bcd17cf9b0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:02.465500 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3681d90a-b258-4a77-b583-c1bcd17cf9b0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:02.465988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3681d90a-b258-4a77-b583-c1bcd17cf9b0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:02.466427 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3681d90a-b258-4a77-b583-c1bcd17cf9b0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:02.467114 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3681d90a-b258-4a77-b583-c1bcd17cf9b0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:02.467571 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3681d90a-b258-4a77-b583-c1bcd17cf9b0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:02.468504 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3681d90a-b258-4a77-b583-c1bcd17cf9b0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:02.477778 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0395f2f4-eb5a-41cb-85ca-9530a1d702e0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0b0326e-96cd-4725-8655-298ba4b30d1b"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:45:02.480032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0395f2f4-eb5a-41cb-85ca-9530a1d702e0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:02.486884 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0395f2f4-eb5a-41cb-85ca-9530a1d702e0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:02.487366 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0395f2f4-eb5a-41cb-85ca-9530a1d702e0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:02.487800 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0395f2f4-eb5a-41cb-85ca-9530a1d702e0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:02.488479 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0395f2f4-eb5a-41cb-85ca-9530a1d702e0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:02.488921 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0395f2f4-eb5a-41cb-85ca-9530a1d702e0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:02.489363 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0395f2f4-eb5a-41cb-85ca-9530a1d702e0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:02.603060 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3681d90a-b258-4a77-b583-c1bcd17cf9b0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:02.611466 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3681d90a-b258-4a77-b583-c1bcd17cf9b0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.156655 Aug 17 19:45:02.612045 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 350/705] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:02 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:02.730149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0395f2f4-eb5a-41cb-85ca-9530a1d702e0 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "POST /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256038 Aug 17 19:45:02.731481 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 356/706] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:45:02 2022] POST /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:45:03.634955 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a48f6359-ad70-441b-b305-8640787b7a51 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:03.635586 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a48f6359-ad70-441b-b305-8640787b7a51 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:03.641981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a48f6359-ad70-441b-b305-8640787b7a51 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:03.642466 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a48f6359-ad70-441b-b305-8640787b7a51 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:03.642905 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a48f6359-ad70-441b-b305-8640787b7a51 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:03.647135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a48f6359-ad70-441b-b305-8640787b7a51 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:03.647135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a48f6359-ad70-441b-b305-8640787b7a51 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:03.647135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a48f6359-ad70-441b-b305-8640787b7a51 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:03.793578 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a48f6359-ad70-441b-b305-8640787b7a51 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:03.802066 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a48f6359-ad70-441b-b305-8640787b7a51 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.171204 Aug 17 19:45:03.802643 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 351/707] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:03 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:04.824221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c452afa6-3e60-4081-abe7-d2cdf5ddcfdb tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:04.825177 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-c452afa6-3e60-4081-abe7-d2cdf5ddcfdb tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:04.831908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c452afa6-3e60-4081-abe7-d2cdf5ddcfdb tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:04.832373 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c452afa6-3e60-4081-abe7-d2cdf5ddcfdb tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:04.832803 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c452afa6-3e60-4081-abe7-d2cdf5ddcfdb tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:04.833507 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c452afa6-3e60-4081-abe7-d2cdf5ddcfdb tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:04.833961 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c452afa6-3e60-4081-abe7-d2cdf5ddcfdb tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:04.834383 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c452afa6-3e60-4081-abe7-d2cdf5ddcfdb tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:04.964564 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-c452afa6-3e60-4081-abe7-d2cdf5ddcfdb tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:04.972017 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-c452afa6-3e60-4081-abe7-d2cdf5ddcfdb tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.152482 Aug 17 19:45:04.972582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 357/708] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:04 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:05.993486 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-bc9d259c-2830-40c9-ae11-e3e3c75c8e8b tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:05.994110 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-bc9d259c-2830-40c9-ae11-e3e3c75c8e8b tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:06.000858 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bc9d259c-2830-40c9-ae11-e3e3c75c8e8b tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:06.001377 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bc9d259c-2830-40c9-ae11-e3e3c75c8e8b tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:06.001817 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bc9d259c-2830-40c9-ae11-e3e3c75c8e8b tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:06.002514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bc9d259c-2830-40c9-ae11-e3e3c75c8e8b tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:06.002969 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bc9d259c-2830-40c9-ae11-e3e3c75c8e8b tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:06.003395 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bc9d259c-2830-40c9-ae11-e3e3c75c8e8b tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:06.136821 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-bc9d259c-2830-40c9-ae11-e3e3c75c8e8b tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:06.139154 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:45:06.146358 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-bc9d259c-2830-40c9-ae11-e3e3c75c8e8b tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.156647 Aug 17 19:45:06.146932 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 352/709] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:05 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:07.167389 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4c69b2b8-6fda-4149-a421-5017ddd708f0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:07.168060 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-4c69b2b8-6fda-4149-a421-5017ddd708f0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:07.174478 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4c69b2b8-6fda-4149-a421-5017ddd708f0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:07.174915 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4c69b2b8-6fda-4149-a421-5017ddd708f0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:07.175352 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4c69b2b8-6fda-4149-a421-5017ddd708f0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:07.176034 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4c69b2b8-6fda-4149-a421-5017ddd708f0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:07.176490 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4c69b2b8-6fda-4149-a421-5017ddd708f0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:07.176913 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4c69b2b8-6fda-4149-a421-5017ddd708f0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:07.303569 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4c69b2b8-6fda-4149-a421-5017ddd708f0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:07.311116 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-4c69b2b8-6fda-4149-a421-5017ddd708f0 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.147575 Aug 17 19:45:07.311678 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 358/710] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:07 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:08.332122 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-23948443-955f-465a-9d36-65ab8493eb30 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:08.332728 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-23948443-955f-465a-9d36-65ab8493eb30 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:08.339996 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-23948443-955f-465a-9d36-65ab8493eb30 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:08.340475 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-23948443-955f-465a-9d36-65ab8493eb30 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:08.340904 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-23948443-955f-465a-9d36-65ab8493eb30 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:08.341612 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-23948443-955f-465a-9d36-65ab8493eb30 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:08.342059 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-23948443-955f-465a-9d36-65ab8493eb30 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:08.342475 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-23948443-955f-465a-9d36-65ab8493eb30 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:08.476618 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-23948443-955f-465a-9d36-65ab8493eb30 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:08.485240 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-23948443-955f-465a-9d36-65ab8493eb30 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.157119 Aug 17 19:45:08.485808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 353/711] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:08 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:45:09.506341 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8cf5ac2a-0de1-45a1-9d73-2fdca85fb054 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:09.507709 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-8cf5ac2a-0de1-45a1-9d73-2fdca85fb054 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:09.514798 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8cf5ac2a-0de1-45a1-9d73-2fdca85fb054 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:09.515532 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8cf5ac2a-0de1-45a1-9d73-2fdca85fb054 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:09.516175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8cf5ac2a-0de1-45a1-9d73-2fdca85fb054 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:09.517181 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8cf5ac2a-0de1-45a1-9d73-2fdca85fb054 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:09.517890 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8cf5ac2a-0de1-45a1-9d73-2fdca85fb054 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:09.518516 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8cf5ac2a-0de1-45a1-9d73-2fdca85fb054 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:09.651094 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8cf5ac2a-0de1-45a1-9d73-2fdca85fb054 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:09.658550 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8cf5ac2a-0de1-45a1-9d73-2fdca85fb054 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1509 microversion: 2.1 time: 0.156142 Aug 17 19:45:09.659105 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 359/712] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:09 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:09.678955 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c325e294-c29b-40be-8ad3-48b57aaffb26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:45:09.679483 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c325e294-c29b-40be-8ad3-48b57aaffb26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:09.685714 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c325e294-c29b-40be-8ad3-48b57aaffb26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:09.686189 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c325e294-c29b-40be-8ad3-48b57aaffb26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:09.687209 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c325e294-c29b-40be-8ad3-48b57aaffb26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:09.687881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c325e294-c29b-40be-8ad3-48b57aaffb26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:09.688325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c325e294-c29b-40be-8ad3-48b57aaffb26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:09.688741 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c325e294-c29b-40be-8ad3-48b57aaffb26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:09.715822 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c325e294-c29b-40be-8ad3-48b57aaffb26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132530) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 19:45:09.776987 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c325e294-c29b-40be-8ad3-48b57aaffb26 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "POST /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555/action" status: 202 len: 0 microversion: 2.1 time: 0.101853 Aug 17 19:45:09.777944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 354/713] 10.222.0.59 () {60 vars in 1278 bytes} [Wed Aug 17 19:45:09 2022] POST /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:45:09.786510 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-af424071-892b-4e59-9059-f3ae4b9af7ee tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:09.787148 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-af424071-892b-4e59-9059-f3ae4b9af7ee tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:09.793191 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-af424071-892b-4e59-9059-f3ae4b9af7ee tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:09.793761 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-af424071-892b-4e59-9059-f3ae4b9af7ee tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:09.794255 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-af424071-892b-4e59-9059-f3ae4b9af7ee tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:09.795000 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-af424071-892b-4e59-9059-f3ae4b9af7ee tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:09.795516 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-af424071-892b-4e59-9059-f3ae4b9af7ee tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:09.796548 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-af424071-892b-4e59-9059-f3ae4b9af7ee tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:09.940383 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-af424071-892b-4e59-9059-f3ae4b9af7ee tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:09.947946 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-af424071-892b-4e59-9059-f3ae4b9af7ee tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1517 microversion: 2.1 time: 0.165198 Aug 17 19:45:09.948520 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 360/714] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:09 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:10.252954 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-68fdaa42-a550-4ee6-98ec-25bd26b3193d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:10.255230 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-68fdaa42-a550-4ee6-98ec-25bd26b3193d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:10.261144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-68fdaa42-a550-4ee6-98ec-25bd26b3193d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:10.261653 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-68fdaa42-a550-4ee6-98ec-25bd26b3193d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:10.262087 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-68fdaa42-a550-4ee6-98ec-25bd26b3193d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:10.262781 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-68fdaa42-a550-4ee6-98ec-25bd26b3193d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:10.263232 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-68fdaa42-a550-4ee6-98ec-25bd26b3193d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:10.263655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-68fdaa42-a550-4ee6-98ec-25bd26b3193d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:10.294066 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-68fdaa42-a550-4ee6-98ec-25bd26b3193d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045015 Aug 17 19:45:10.294615 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 355/715] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:45:10 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:45:10.432968 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-23ecf9ad-2a20-4e40-8739-70697515328f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:10.433412 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-23ecf9ad-2a20-4e40-8739-70697515328f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:10.439771 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-23ecf9ad-2a20-4e40-8739-70697515328f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:10.440283 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-23ecf9ad-2a20-4e40-8739-70697515328f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:10.440712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-23ecf9ad-2a20-4e40-8739-70697515328f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:10.441439 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-23ecf9ad-2a20-4e40-8739-70697515328f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:10.441894 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-23ecf9ad-2a20-4e40-8739-70697515328f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:10.442317 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-23ecf9ad-2a20-4e40-8739-70697515328f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:10.475157 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-23ecf9ad-2a20-4e40-8739-70697515328f tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments/8ae0a7ba-a11b-470d-b7d6-a40066d68ba4" status: 200 len: 194 microversion: 2.1 time: 0.046197 Aug 17 19:45:10.475744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 361/716] 10.222.0.59 () {58 vars in 1413 bytes} [Wed Aug 17 19:45:10 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments/8ae0a7ba-a11b-470d-b7d6-a40066d68ba4 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:45:10.485793 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a32352bf-1e53-4797-87d9-0b85eecc71ac tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:10.486289 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a32352bf-1e53-4797-87d9-0b85eecc71ac tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:10.492231 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a32352bf-1e53-4797-87d9-0b85eecc71ac tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:10.492717 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a32352bf-1e53-4797-87d9-0b85eecc71ac tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:10.493153 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a32352bf-1e53-4797-87d9-0b85eecc71ac tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:10.493864 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a32352bf-1e53-4797-87d9-0b85eecc71ac tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:10.494317 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a32352bf-1e53-4797-87d9-0b85eecc71ac tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:10.494740 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a32352bf-1e53-4797-87d9-0b85eecc71ac tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:10.581745 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-a32352bf-1e53-4797-87d9-0b85eecc71ac tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lazy-loading 'services' on Instance uuid 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:45:10.654698 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a32352bf-1e53-4797-87d9-0b85eecc71ac tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments/8ae0a7ba-a11b-470d-b7d6-a40066d68ba4" status: 202 len: 0 microversion: 2.1 time: 0.172566 Aug 17 19:45:10.655347 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 356/717] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 17 19:45:10 2022] DELETE /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments/8ae0a7ba-a11b-470d-b7d6-a40066d68ba4 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:45:10.969128 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-341d9d84-26cb-4927-bec6-cb3487f5087f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:10.969704 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-341d9d84-26cb-4927-bec6-cb3487f5087f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:10.976658 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-341d9d84-26cb-4927-bec6-cb3487f5087f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:10.977129 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-341d9d84-26cb-4927-bec6-cb3487f5087f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:10.977595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-341d9d84-26cb-4927-bec6-cb3487f5087f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:10.978292 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-341d9d84-26cb-4927-bec6-cb3487f5087f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:10.978748 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-341d9d84-26cb-4927-bec6-cb3487f5087f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:10.979173 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-341d9d84-26cb-4927-bec6-cb3487f5087f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:11.114274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-341d9d84-26cb-4927-bec6-cb3487f5087f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:11.121653 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-341d9d84-26cb-4927-bec6-cb3487f5087f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1519 microversion: 2.1 time: 0.156460 Aug 17 19:45:11.122216 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 362/718] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:10 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:11.393579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-cb898b87-a27f-4ea2-9c20-c118bfe0a9e2 req-a2b57191-eaa4-48c2-96a2-05d0e49e6284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76985445-294d-45f5-9f95-40951eed1555", "name": "network-vif-unplugged", "status": "completed", "tag": "380031c9-b01e-4d04-9d20-1e65825341f8"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:45:11.405844 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-cb898b87-a27f-4ea2-9c20-c118bfe0a9e2 req-a2b57191-eaa4-48c2-96a2-05d0e49e6284 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:11.406322 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-cb898b87-a27f-4ea2-9c20-c118bfe0a9e2 req-a2b57191-eaa4-48c2-96a2-05d0e49e6284 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:11.406749 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-cb898b87-a27f-4ea2-9c20-c118bfe0a9e2 req-a2b57191-eaa4-48c2-96a2-05d0e49e6284 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:11.418466 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.compute.server_external_events [req-cb898b87-a27f-4ea2-9c20-c118bfe0a9e2 req-a2b57191-eaa4-48c2-96a2-05d0e49e6284 service nova] Unable to find a host for instance 76985445-294d-45f5-9f95-40951eed1555. Dropping event network-vif-unplugged {{(pid=132530) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 17 19:45:11.419430 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-cb898b87-a27f-4ea2-9c20-c118bfe0a9e2 req-a2b57191-eaa4-48c2-96a2-05d0e49e6284 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031436 Aug 17 19:45:11.420713 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 357/719] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 17 19:45:12.142856 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e89ee2a6-2ad7-46b0-a980-94d49d4fd89d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:12.143490 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e89ee2a6-2ad7-46b0-a980-94d49d4fd89d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:12.149868 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e89ee2a6-2ad7-46b0-a980-94d49d4fd89d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:12.150356 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e89ee2a6-2ad7-46b0-a980-94d49d4fd89d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:12.150789 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e89ee2a6-2ad7-46b0-a980-94d49d4fd89d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:12.151484 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e89ee2a6-2ad7-46b0-a980-94d49d4fd89d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:12.151931 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e89ee2a6-2ad7-46b0-a980-94d49d4fd89d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:12.152352 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e89ee2a6-2ad7-46b0-a980-94d49d4fd89d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:12.283542 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e89ee2a6-2ad7-46b0-a980-94d49d4fd89d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:12.290963 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e89ee2a6-2ad7-46b0-a980-94d49d4fd89d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1575 microversion: 2.1 time: 0.152640 Aug 17 19:45:12.291528 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 363/720] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:12 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:12.831639 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b4f2f599-7c9a-4bc6-902d-33be402693fd tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:12.832250 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b4f2f599-7c9a-4bc6-902d-33be402693fd tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:12.838680 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b4f2f599-7c9a-4bc6-902d-33be402693fd tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:12.839162 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b4f2f599-7c9a-4bc6-902d-33be402693fd tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:12.839601 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b4f2f599-7c9a-4bc6-902d-33be402693fd tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:12.840290 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b4f2f599-7c9a-4bc6-902d-33be402693fd tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:12.840745 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b4f2f599-7c9a-4bc6-902d-33be402693fd tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:12.841175 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b4f2f599-7c9a-4bc6-902d-33be402693fd tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:12.869901 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b4f2f599-7c9a-4bc6-902d-33be402693fd tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments/e0b0326e-96cd-4725-8655-298ba4b30d1b" status: 200 len: 194 microversion: 2.1 time: 0.042265 Aug 17 19:45:12.870465 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 358/721] 10.222.0.59 () {58 vars in 1413 bytes} [Wed Aug 17 19:45:12 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments/e0b0326e-96cd-4725-8655-298ba4b30d1b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:45:12.880755 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-059c9240-3e04-402f-af26-0a3338aa4705 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:12.881385 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-059c9240-3e04-402f-af26-0a3338aa4705 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:12.887344 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-059c9240-3e04-402f-af26-0a3338aa4705 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:12.887821 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-059c9240-3e04-402f-af26-0a3338aa4705 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:12.888250 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-059c9240-3e04-402f-af26-0a3338aa4705 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:12.888927 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-059c9240-3e04-402f-af26-0a3338aa4705 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:12.889402 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-059c9240-3e04-402f-af26-0a3338aa4705 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:12.889819 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-059c9240-3e04-402f-af26-0a3338aa4705 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:12.968946 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.objects.instance [None req-059c9240-3e04-402f-af26-0a3338aa4705 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lazy-loading 'services' on Instance uuid 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 {{(pid=132531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:45:13.039496 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-059c9240-3e04-402f-af26-0a3338aa4705 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments/e0b0326e-96cd-4725-8655-298ba4b30d1b" status: 202 len: 0 microversion: 2.1 time: 0.162310 Aug 17 19:45:13.040013 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 364/722] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 17 19:45:12 2022] DELETE /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments/e0b0326e-96cd-4725-8655-298ba4b30d1b => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:45:13.312524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-34f265ff-6082-4f2d-8786-0a5ee675d978 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:13.313050 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-34f265ff-6082-4f2d-8786-0a5ee675d978 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:13.319024 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-34f265ff-6082-4f2d-8786-0a5ee675d978 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:13.319497 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-34f265ff-6082-4f2d-8786-0a5ee675d978 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:13.319926 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-34f265ff-6082-4f2d-8786-0a5ee675d978 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:13.320601 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-34f265ff-6082-4f2d-8786-0a5ee675d978 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:13.321047 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-34f265ff-6082-4f2d-8786-0a5ee675d978 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:13.321495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-34f265ff-6082-4f2d-8786-0a5ee675d978 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:13.454109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-34f265ff-6082-4f2d-8786-0a5ee675d978 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:13.461694 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-34f265ff-6082-4f2d-8786-0a5ee675d978 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1575 microversion: 2.1 time: 0.153715 Aug 17 19:45:13.462266 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 359/723] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:13 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:14.208574 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-7f1805a0-8a3b-4003-a9e4-9fff56c11791 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:14.210909 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-7f1805a0-8a3b-4003-a9e4-9fff56c11791 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:14.212803 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=42 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:45:14.219045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7f1805a0-8a3b-4003-a9e4-9fff56c11791 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:14.219523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7f1805a0-8a3b-4003-a9e4-9fff56c11791 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:14.219953 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7f1805a0-8a3b-4003-a9e4-9fff56c11791 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:14.220643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7f1805a0-8a3b-4003-a9e4-9fff56c11791 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:14.221096 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7f1805a0-8a3b-4003-a9e4-9fff56c11791 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:14.221548 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7f1805a0-8a3b-4003-a9e4-9fff56c11791 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:14.249771 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-7f1805a0-8a3b-4003-a9e4-9fff56c11791 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045878 Aug 17 19:45:14.250317 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 365/724] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:45:14 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 19:45:14.361123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4e2871b4-1c90-4df5-bffd-2660414b3d6c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:14.363267 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4e2871b4-1c90-4df5-bffd-2660414b3d6c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:14.369518 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e2871b4-1c90-4df5-bffd-2660414b3d6c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:14.369991 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e2871b4-1c90-4df5-bffd-2660414b3d6c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:14.370425 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e2871b4-1c90-4df5-bffd-2660414b3d6c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:14.371096 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e2871b4-1c90-4df5-bffd-2660414b3d6c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:14.371542 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e2871b4-1c90-4df5-bffd-2660414b3d6c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:14.371957 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4e2871b4-1c90-4df5-bffd-2660414b3d6c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:14.399360 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4e2871b4-1c90-4df5-bffd-2660414b3d6c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043049 Aug 17 19:45:14.399902 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 360/725] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:45:14 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 19:45:14.460050 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f1aa4f6d-cbdc-4ccd-a943-0cd9933b42f7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:14.460540 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f1aa4f6d-cbdc-4ccd-a943-0cd9933b42f7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:14.466322 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1aa4f6d-cbdc-4ccd-a943-0cd9933b42f7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:14.466796 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1aa4f6d-cbdc-4ccd-a943-0cd9933b42f7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:14.467228 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1aa4f6d-cbdc-4ccd-a943-0cd9933b42f7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:14.468390 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1aa4f6d-cbdc-4ccd-a943-0cd9933b42f7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:14.468836 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1aa4f6d-cbdc-4ccd-a943-0cd9933b42f7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:14.469282 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1aa4f6d-cbdc-4ccd-a943-0cd9933b42f7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:14.482714 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b7f5cd42-429d-4bf2-a3dd-915dade7c5cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:14.483904 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b7f5cd42-429d-4bf2-a3dd-915dade7c5cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:14.489799 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b7f5cd42-429d-4bf2-a3dd-915dade7c5cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:14.490281 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b7f5cd42-429d-4bf2-a3dd-915dade7c5cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:14.490719 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b7f5cd42-429d-4bf2-a3dd-915dade7c5cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:14.491432 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b7f5cd42-429d-4bf2-a3dd-915dade7c5cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:14.491865 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b7f5cd42-429d-4bf2-a3dd-915dade7c5cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:14.492298 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b7f5cd42-429d-4bf2-a3dd-915dade7c5cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:14.493692 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f1aa4f6d-cbdc-4ccd-a943-0cd9933b42f7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:45:14.542839 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:45:14.571386 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f1aa4f6d-cbdc-4ccd-a943-0cd9933b42f7 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 204 len: 0 microversion: 2.1 time: 0.114773 Aug 17 19:45:14.571973 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 366/726] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:45:14 2022] DELETE /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:45:14.580999 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9fd77eb5-0412-40bb-b7ff-7fcb73d9c825 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:14.581724 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9fd77eb5-0412-40bb-b7ff-7fcb73d9c825 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:14.587518 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fd77eb5-0412-40bb-b7ff-7fcb73d9c825 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:14.588000 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fd77eb5-0412-40bb-b7ff-7fcb73d9c825 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:14.588441 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fd77eb5-0412-40bb-b7ff-7fcb73d9c825 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:14.589129 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fd77eb5-0412-40bb-b7ff-7fcb73d9c825 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:14.589610 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fd77eb5-0412-40bb-b7ff-7fcb73d9c825 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:14.590032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fd77eb5-0412-40bb-b7ff-7fcb73d9c825 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:14.642655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b7f5cd42-429d-4bf2-a3dd-915dade7c5cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:14.650358 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b7f5cd42-429d-4bf2-a3dd-915dade7c5cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1575 microversion: 2.1 time: 0.171517 Aug 17 19:45:14.650929 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 361/727] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:14 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:45:14.726295 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9fd77eb5-0412-40bb-b7ff-7fcb73d9c825 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:14.733646 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9fd77eb5-0412-40bb-b7ff-7fcb73d9c825 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1674 microversion: 2.1 time: 0.157159 Aug 17 19:45:14.734223 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 367/728] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:14 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:45:15.671888 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5e0be8b8-8d10-45c2-b5d3-677a82194bd9 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:15.672510 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5e0be8b8-8d10-45c2-b5d3-677a82194bd9 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:15.678833 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5e0be8b8-8d10-45c2-b5d3-677a82194bd9 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:15.679312 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5e0be8b8-8d10-45c2-b5d3-677a82194bd9 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:15.679748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5e0be8b8-8d10-45c2-b5d3-677a82194bd9 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:15.680440 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5e0be8b8-8d10-45c2-b5d3-677a82194bd9 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:15.680896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5e0be8b8-8d10-45c2-b5d3-677a82194bd9 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:15.681347 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5e0be8b8-8d10-45c2-b5d3-677a82194bd9 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:15.755716 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ee217e22-f61a-4ec8-9686-b2939db41e00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:15.756423 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ee217e22-f61a-4ec8-9686-b2939db41e00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:15.763556 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ee217e22-f61a-4ec8-9686-b2939db41e00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:15.764046 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ee217e22-f61a-4ec8-9686-b2939db41e00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:15.765100 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ee217e22-f61a-4ec8-9686-b2939db41e00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:15.765830 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ee217e22-f61a-4ec8-9686-b2939db41e00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:15.766290 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ee217e22-f61a-4ec8-9686-b2939db41e00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:15.766732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ee217e22-f61a-4ec8-9686-b2939db41e00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:15.822436 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-5e0be8b8-8d10-45c2-b5d3-677a82194bd9 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:15.830922 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5e0be8b8-8d10-45c2-b5d3-677a82194bd9 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1575 microversion: 2.1 time: 0.162904 Aug 17 19:45:15.831584 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 362/729] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:15 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:15.906869 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-ee217e22-f61a-4ec8-9686-b2939db41e00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:15.914500 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ee217e22-f61a-4ec8-9686-b2939db41e00 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1674 microversion: 2.1 time: 0.163267 Aug 17 19:45:15.915065 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 368/730] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:15 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:45:16.851805 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-686758f5-bca0-4623-bda0-dcff5a75fb2d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:16.852405 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-686758f5-bca0-4623-bda0-dcff5a75fb2d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:16.859587 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-686758f5-bca0-4623-bda0-dcff5a75fb2d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:16.860082 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-686758f5-bca0-4623-bda0-dcff5a75fb2d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:16.860525 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-686758f5-bca0-4623-bda0-dcff5a75fb2d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:16.861241 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-686758f5-bca0-4623-bda0-dcff5a75fb2d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:16.861855 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-686758f5-bca0-4623-bda0-dcff5a75fb2d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:16.862284 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-686758f5-bca0-4623-bda0-dcff5a75fb2d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:16.937426 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3b279310-dfab-440b-8b59-6e0fa8f21b0c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:16.938733 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3b279310-dfab-440b-8b59-6e0fa8f21b0c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:16.945926 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3b279310-dfab-440b-8b59-6e0fa8f21b0c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:16.946495 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3b279310-dfab-440b-8b59-6e0fa8f21b0c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:16.947242 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3b279310-dfab-440b-8b59-6e0fa8f21b0c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:16.948014 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3b279310-dfab-440b-8b59-6e0fa8f21b0c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:16.948683 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3b279310-dfab-440b-8b59-6e0fa8f21b0c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:16.949623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3b279310-dfab-440b-8b59-6e0fa8f21b0c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:17.031125 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-686758f5-bca0-4623-bda0-dcff5a75fb2d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:17.032797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3b279310-dfab-440b-8b59-6e0fa8f21b0c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f698e4a2f6074756adc52f6b6b9ff9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8e17f7523b4492394df211a01a4193c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:17.039181 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-686758f5-bca0-4623-bda0-dcff5a75fb2d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1575 microversion: 2.1 time: 0.191147 Aug 17 19:45:17.039759 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 363/731] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:16 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:17.040533 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3b279310-dfab-440b-8b59-6e0fa8f21b0c tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 200 len: 1606 microversion: 2.1 time: 0.108640 Aug 17 19:45:17.041106 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 369/732] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:16 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 1606 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:17.329180 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-040e431a-48b0-4469-87a8-6ffc87be80bc req-fed15dd1-3aa4-4aeb-aff8-33d6c92bd974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c8ca5b1-5ab2-48cf-824d-367bbac94eb0", "name": "network-vif-deleted", "tag": "8d0240ee-c805-4cfa-aded-24a776b15f49"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:45:17.341342 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-040e431a-48b0-4469-87a8-6ffc87be80bc req-fed15dd1-3aa4-4aeb-aff8-33d6c92bd974 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:17.341825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-040e431a-48b0-4469-87a8-6ffc87be80bc req-fed15dd1-3aa4-4aeb-aff8-33d6c92bd974 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:17.342778 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-040e431a-48b0-4469-87a8-6ffc87be80bc req-fed15dd1-3aa4-4aeb-aff8-33d6c92bd974 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:17.354523 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-040e431a-48b0-4469-87a8-6ffc87be80bc req-fed15dd1-3aa4-4aeb-aff8-33d6c92bd974 service nova] Creating event network-vif-deleted:8d0240ee-c805-4cfa-aded-24a776b15f49 for instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 on hv-cinder-85069 Aug 17 19:45:17.361101 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-040e431a-48b0-4469-87a8-6ffc87be80bc req-fed15dd1-3aa4-4aeb-aff8-33d6c92bd974 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102433 Aug 17 19:45:17.361792 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 364/733] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:45:18.060049 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a2f8100b-2a96-476f-be6c-5fbc4075126e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:18.060606 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a2f8100b-2a96-476f-be6c-5fbc4075126e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:18.063510 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-28c49a17-98e0-48ca-bbf0-b75c6da83e1d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:18.064223 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-28c49a17-98e0-48ca-bbf0-b75c6da83e1d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:18.067371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2f8100b-2a96-476f-be6c-5fbc4075126e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:18.067972 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2f8100b-2a96-476f-be6c-5fbc4075126e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:18.068599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2f8100b-2a96-476f-be6c-5fbc4075126e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:18.069543 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2f8100b-2a96-476f-be6c-5fbc4075126e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:18.070065 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2f8100b-2a96-476f-be6c-5fbc4075126e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:18.070471 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-28c49a17-98e0-48ca-bbf0-b75c6da83e1d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:18.070618 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2f8100b-2a96-476f-be6c-5fbc4075126e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:18.071254 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-28c49a17-98e0-48ca-bbf0-b75c6da83e1d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:18.071698 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-28c49a17-98e0-48ca-bbf0-b75c6da83e1d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:18.072404 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-28c49a17-98e0-48ca-bbf0-b75c6da83e1d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:18.072862 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-28c49a17-98e0-48ca-bbf0-b75c6da83e1d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:18.073315 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-28c49a17-98e0-48ca-bbf0-b75c6da83e1d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:18.089802 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-28c49a17-98e0-48ca-bbf0-b75c6da83e1d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] HTTP exception thrown: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-28c49a17-98e0-48ca-bbf0-b75c6da83e1d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Request method failure captured: Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 HTTP/1.1 Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPfXD1ndUVYJ7hH7H4oWcdTbPJtAirxbKC83GBbpzadUv-bSOs-IpNMrPiexeQZ25DshurFFhyonDk_UlF15S9wi4sJJ8E-u2w-iRJuP33fdm7s4JvS5p2QfNXSGD57NNGck2XAQ_ZqHccAx_Wa-x0Bo96sOdwSpYfRuS7cnE0CD3I Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: d8e17f7523b4492394df211a01a4193c Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:45:18.091748 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:45:18.093999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d8e17f7523b4492394df211a01a4193c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d8e17f7523b4492394df211a01a4193c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d8e17f7523b4492394df211a01a4193c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d8e17f7523b4492394df211a01a4193c"}]}] Aug 17 19:45:18.093999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:18.093999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: d8e17f7523b4492394df211a01a4193c Aug 17 19:45:18.093999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:18.093999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeTestJSON-984721636-project Aug 17 19:45:18.093999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:45:18.093999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:45:18.093999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: f698e4a2f6074756adc52f6b6b9ff9fd Aug 17 19:45:18.093999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeTestJSON-984721636-project Aug 17 19:45:18.093999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:45:18.093999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:18.093999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '4c8ca5b1-5ab2-48cf-824d-367bbac94eb0'} Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:45:18.094891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:18.097648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:18.098973 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-28c49a17-98e0-48ca-bbf0-b75c6da83e1d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Returning 404 to user: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:45:18.098973 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-28c49a17-98e0-48ca-bbf0-b75c6da83e1d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 404 len: 111 microversion: 2.1 time: 0.035604 Aug 17 19:45:18.098973 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 365/734] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:18 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 19:45:18.102986 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3841c6a2-4f73-4bd4-a09d-6c1969e6979d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '.version_select at 0x7f368a02a670>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:18.125125 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3841c6a2-4f73-4bd4-a09d-6c1969e6979d tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-455260183" status: 202 len: 0 microversion: 2.1 time: 0.025748 Aug 17 19:45:18.125968 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 366/735] 10.222.0.59 () {58 vars in 1218 bytes} [Wed Aug 17 19:45:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-455260183 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:45:18.227652 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a2f8100b-2a96-476f-be6c-5fbc4075126e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:18.236156 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a2f8100b-2a96-476f-be6c-5fbc4075126e tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1575 microversion: 2.1 time: 0.180006 Aug 17 19:45:18.236731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 370/736] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:18 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:19.257940 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b8237043-855d-45cd-99fa-8889e4ff91cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:19.258457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b8237043-855d-45cd-99fa-8889e4ff91cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:19.265230 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8237043-855d-45cd-99fa-8889e4ff91cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:19.265714 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8237043-855d-45cd-99fa-8889e4ff91cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:19.266148 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8237043-855d-45cd-99fa-8889e4ff91cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:19.266840 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8237043-855d-45cd-99fa-8889e4ff91cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:19.267295 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8237043-855d-45cd-99fa-8889e4ff91cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:19.267721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b8237043-855d-45cd-99fa-8889e4ff91cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:19.395713 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b8237043-855d-45cd-99fa-8889e4ff91cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:19.403211 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b8237043-855d-45cd-99fa-8889e4ff91cd tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1575 microversion: 2.1 time: 0.149751 Aug 17 19:45:19.403770 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 367/737] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:19 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:20.423814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4beccd8b-17eb-4f89-ace1-b50069ba8944 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:20.424450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-4beccd8b-17eb-4f89-ace1-b50069ba8944 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:20.430837 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4beccd8b-17eb-4f89-ace1-b50069ba8944 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:20.431311 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4beccd8b-17eb-4f89-ace1-b50069ba8944 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:20.431734 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4beccd8b-17eb-4f89-ace1-b50069ba8944 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:20.432403 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4beccd8b-17eb-4f89-ace1-b50069ba8944 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:20.432848 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4beccd8b-17eb-4f89-ace1-b50069ba8944 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:20.433297 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4beccd8b-17eb-4f89-ace1-b50069ba8944 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:20.566540 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4beccd8b-17eb-4f89-ace1-b50069ba8944 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:20.573914 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-4beccd8b-17eb-4f89-ace1-b50069ba8944 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1575 microversion: 2.1 time: 0.153968 Aug 17 19:45:20.574724 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 371/738] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:20 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:21.002239 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5d7053fc-e924-4a40-8b0d-20816c7d7999 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:21.002720 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5d7053fc-e924-4a40-8b0d-20816c7d7999 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:21.009069 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d7053fc-e924-4a40-8b0d-20816c7d7999 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:21.009573 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d7053fc-e924-4a40-8b0d-20816c7d7999 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:21.010013 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d7053fc-e924-4a40-8b0d-20816c7d7999 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:21.010678 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d7053fc-e924-4a40-8b0d-20816c7d7999 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:21.011126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d7053fc-e924-4a40-8b0d-20816c7d7999 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:21.011552 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5d7053fc-e924-4a40-8b0d-20816c7d7999 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:21.024664 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-5d7053fc-e924-4a40-8b0d-20816c7d7999 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] HTTP exception thrown: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5d7053fc-e924-4a40-8b0d-20816c7d7999 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Request method failure captured: Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: DELETE /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 HTTP/1.1 Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPfXD1ndUVYJ7hH7H4oWcdTbPJtAirxbKC83GBbpzadUv-bSOs-IpNMrPiexeQZ25DshurFFhyonDk_UlF15S9wi4sJJ8E-u2w-iRJuP33fdm7s4JvS5p2QfNXSGD57NNGck2XAQ_ZqHccAx_Wa-x0Bo96sOdwSpYfRuS7cnE0CD3I Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: d8e17f7523b4492394df211a01a4193c Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:45:21.026190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:45:21.027721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d8e17f7523b4492394df211a01a4193c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d8e17f7523b4492394df211a01a4193c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d8e17f7523b4492394df211a01a4193c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d8e17f7523b4492394df211a01a4193c"}]}] Aug 17 19:45:21.027721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:21.027721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: d8e17f7523b4492394df211a01a4193c Aug 17 19:45:21.027721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:21.027721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeTestJSON-984721636-project Aug 17 19:45:21.027721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:45:21.027721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:45:21.027721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: f698e4a2f6074756adc52f6b6b9ff9fd Aug 17 19:45:21.027721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeTestJSON-984721636-project Aug 17 19:45:21.027721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:45:21.027721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:21.027721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '4c8ca5b1-5ab2-48cf-824d-367bbac94eb0'} Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:45:21.028563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:21.029962 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:21.031854 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5d7053fc-e924-4a40-8b0d-20816c7d7999 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Returning 404 to user: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:45:21.031854 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5d7053fc-e924-4a40-8b0d-20816c7d7999 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 404 len: 111 microversion: 2.1 time: 0.029161 Aug 17 19:45:21.031854 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 368/739] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:45:20 2022] DELETE /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:45:21.037048 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-20c32282-8214-4c9f-b9a5-d88633bb2ae9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:21.037687 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-20c32282-8214-4c9f-b9a5-d88633bb2ae9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:21.043472 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20c32282-8214-4c9f-b9a5-d88633bb2ae9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:21.043950 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20c32282-8214-4c9f-b9a5-d88633bb2ae9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:21.044380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20c32282-8214-4c9f-b9a5-d88633bb2ae9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:21.045062 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20c32282-8214-4c9f-b9a5-d88633bb2ae9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:21.045553 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20c32282-8214-4c9f-b9a5-d88633bb2ae9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:21.045975 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-20c32282-8214-4c9f-b9a5-d88633bb2ae9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:21.059487 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-20c32282-8214-4c9f-b9a5-d88633bb2ae9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] HTTP exception thrown: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-20c32282-8214-4c9f-b9a5-d88633bb2ae9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Request method failure captured: Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 HTTP/1.1 Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPfXD1ndUVYJ7hH7H4oWcdTbPJtAirxbKC83GBbpzadUv-bSOs-IpNMrPiexeQZ25DshurFFhyonDk_UlF15S9wi4sJJ8E-u2w-iRJuP33fdm7s4JvS5p2QfNXSGD57NNGck2XAQ_ZqHccAx_Wa-x0Bo96sOdwSpYfRuS7cnE0CD3I Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: d8e17f7523b4492394df211a01a4193c Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:45:21.061023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:45:21.062570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d8e17f7523b4492394df211a01a4193c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d8e17f7523b4492394df211a01a4193c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d8e17f7523b4492394df211a01a4193c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d8e17f7523b4492394df211a01a4193c"}]}] Aug 17 19:45:21.062570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:21.062570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: d8e17f7523b4492394df211a01a4193c Aug 17 19:45:21.062570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:21.062570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-AttachVolumeTestJSON-984721636-project Aug 17 19:45:21.062570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:45:21.062570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:45:21.062570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: f698e4a2f6074756adc52f6b6b9ff9fd Aug 17 19:45:21.062570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-AttachVolumeTestJSON-984721636-project Aug 17 19:45:21.062570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:45:21.062570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:21.062570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '4c8ca5b1-5ab2-48cf-824d-367bbac94eb0'} Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:45:21.063436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. Aug 17 19:45:21.064882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:21.066260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-20c32282-8214-4c9f-b9a5-d88633bb2ae9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Returning 404 to user: Instance 4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:45:21.066260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-20c32282-8214-4c9f-b9a5-d88633bb2ae9 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0" status: 404 len: 111 microversion: 2.1 time: 0.029239 Aug 17 19:45:21.066260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 372/740] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:21 2022] GET /compute/v2.1/servers/4c8ca5b1-5ab2-48cf-824d-367bbac94eb0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:45:21.595340 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-19e6071b-75c5-4b44-95b8-d339cdb9648f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:21.595976 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-19e6071b-75c5-4b44-95b8-d339cdb9648f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:21.597916 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:45:21.603075 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-19e6071b-75c5-4b44-95b8-d339cdb9648f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:21.603557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-19e6071b-75c5-4b44-95b8-d339cdb9648f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:21.603983 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-19e6071b-75c5-4b44-95b8-d339cdb9648f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:21.604665 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-19e6071b-75c5-4b44-95b8-d339cdb9648f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:21.605116 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-19e6071b-75c5-4b44-95b8-d339cdb9648f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:21.605566 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-19e6071b-75c5-4b44-95b8-d339cdb9648f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:21.733951 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-19e6071b-75c5-4b44-95b8-d339cdb9648f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:21.741339 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-19e6071b-75c5-4b44-95b8-d339cdb9648f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1575 microversion: 2.1 time: 0.150444 Aug 17 19:45:21.741927 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 369/741] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:21 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:22.196119 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-76b94913-b4cf-4a0e-9e0b-58b79730c41b tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:22.196620 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-76b94913-b4cf-4a0e-9e0b-58b79730c41b tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:22.204290 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-76b94913-b4cf-4a0e-9e0b-58b79730c41b tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:22.204767 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-76b94913-b4cf-4a0e-9e0b-58b79730c41b tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:22.205197 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-76b94913-b4cf-4a0e-9e0b-58b79730c41b tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:22.205902 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-76b94913-b4cf-4a0e-9e0b-58b79730c41b tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:22.206348 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-76b94913-b4cf-4a0e-9e0b-58b79730c41b tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:22.206765 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-76b94913-b4cf-4a0e-9e0b-58b79730c41b tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:22.220598 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-76b94913-b4cf-4a0e-9e0b-58b79730c41b tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] HTTP exception thrown: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-76b94913-b4cf-4a0e-9e0b-58b79730c41b tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Request method failure captured: Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: DELETE /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 HTTP/1.1 Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPfXD1ndUVYJ7hH7H4oWcdTbPJtAirxbKC83GBbpzadUv-bSOs-IpNMrPiexeQZ25DshurFFhyonDk_UlF15S9wi4sJJ8E-u2w-iRJuP33fdm7s4JvS5p2QfNXSGD57NNGck2XAQ_ZqHccAx_Wa-x0Bo96sOdwSpYfRuS7cnE0CD3I Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: d8e17f7523b4492394df211a01a4193c Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:45:22.222149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:45:22.223797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d8e17f7523b4492394df211a01a4193c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d8e17f7523b4492394df211a01a4193c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d8e17f7523b4492394df211a01a4193c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d8e17f7523b4492394df211a01a4193c"}]}] Aug 17 19:45:22.223797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:22.223797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: d8e17f7523b4492394df211a01a4193c Aug 17 19:45:22.223797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:22.223797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-AttachVolumeTestJSON-984721636-project Aug 17 19:45:22.223797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:45:22.223797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:45:22.223797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: f698e4a2f6074756adc52f6b6b9ff9fd Aug 17 19:45:22.223797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-AttachVolumeTestJSON-984721636-project Aug 17 19:45:22.223797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:45:22.223797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:45:22.223797 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '0602879a-bbc5-4632-8412-a72ea55b9068'} Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:45:22.224721 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:45:22.226274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:22.227750 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-76b94913-b4cf-4a0e-9e0b-58b79730c41b tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Returning 404 to user: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:45:22.227750 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-76b94913-b4cf-4a0e-9e0b-58b79730c41b tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 404 len: 111 microversion: 2.1 time: 0.031191 Aug 17 19:45:22.227750 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 373/742] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:45:22 2022] DELETE /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:45:22.231817 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e1066047-b17b-45f5-a7fc-580cf2f554e3 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:22.232429 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e1066047-b17b-45f5-a7fc-580cf2f554e3 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] [instance: 0602879a-bbc5-4632-8412-a72ea55b9068] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:22.238734 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e1066047-b17b-45f5-a7fc-580cf2f554e3 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:22.239205 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e1066047-b17b-45f5-a7fc-580cf2f554e3 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:22.239634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e1066047-b17b-45f5-a7fc-580cf2f554e3 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:22.240313 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e1066047-b17b-45f5-a7fc-580cf2f554e3 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:22.240762 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e1066047-b17b-45f5-a7fc-580cf2f554e3 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:22.241181 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e1066047-b17b-45f5-a7fc-580cf2f554e3 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:22.253936 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-e1066047-b17b-45f5-a7fc-580cf2f554e3 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] HTTP exception thrown: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e1066047-b17b-45f5-a7fc-580cf2f554e3 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Request method failure captured: Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 HTTP/1.1 Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPfXD1ndUVYJ7hH7H4oWcdTbPJtAirxbKC83GBbpzadUv-bSOs-IpNMrPiexeQZ25DshurFFhyonDk_UlF15S9wi4sJJ8E-u2w-iRJuP33fdm7s4JvS5p2QfNXSGD57NNGck2XAQ_ZqHccAx_Wa-x0Bo96sOdwSpYfRuS7cnE0CD3I Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: d8e17f7523b4492394df211a01a4193c Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:45:22.255407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:45:22.256887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d8e17f7523b4492394df211a01a4193c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d8e17f7523b4492394df211a01a4193c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d8e17f7523b4492394df211a01a4193c", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d8e17f7523b4492394df211a01a4193c"}]}] Aug 17 19:45:22.256887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:22.256887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: d8e17f7523b4492394df211a01a4193c Aug 17 19:45:22.256887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeTestJSON-984721636 Aug 17 19:45:22.256887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeTestJSON-984721636-project Aug 17 19:45:22.256887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:45:22.256887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:45:22.256887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: f698e4a2f6074756adc52f6b6b9ff9fd Aug 17 19:45:22.256887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeTestJSON-984721636-project Aug 17 19:45:22.256887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:45:22.256887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:45:22.256887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '0602879a-bbc5-4632-8412-a72ea55b9068'} Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:45:22.257763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. Aug 17 19:45:22.259121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:22.260355 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e1066047-b17b-45f5-a7fc-580cf2f554e3 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] Returning 404 to user: Instance 0602879a-bbc5-4632-8412-a72ea55b9068 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:45:22.260355 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e1066047-b17b-45f5-a7fc-580cf2f554e3 tempest-AttachVolumeTestJSON-984721636 tempest-AttachVolumeTestJSON-984721636-project] 10.222.0.59 "GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068" status: 404 len: 111 microversion: 2.1 time: 0.028792 Aug 17 19:45:22.260355 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 370/743] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:22 2022] GET /compute/v2.1/servers/0602879a-bbc5-4632-8412-a72ea55b9068 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:45:22.762622 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1016276f-6173-49c4-9d74-32d222e4abb1 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:22.763231 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1016276f-6173-49c4-9d74-32d222e4abb1 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:22.769697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1016276f-6173-49c4-9d74-32d222e4abb1 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:22.770177 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1016276f-6173-49c4-9d74-32d222e4abb1 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:22.770611 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1016276f-6173-49c4-9d74-32d222e4abb1 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:22.771294 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1016276f-6173-49c4-9d74-32d222e4abb1 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:22.771747 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1016276f-6173-49c4-9d74-32d222e4abb1 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:22.772166 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1016276f-6173-49c4-9d74-32d222e4abb1 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:22.904591 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1016276f-6173-49c4-9d74-32d222e4abb1 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:22.912185 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1016276f-6173-49c4-9d74-32d222e4abb1 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1575 microversion: 2.1 time: 0.153482 Aug 17 19:45:22.912748 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 374/744] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:22 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:23.484453 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-a3ad6a79-0dae-4318-a4ce-101f49ce4c1c req-3bb34958-b0c9-46d8-8a63-1266d2e45ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76985445-294d-45f5-9f95-40951eed1555", "name": "network-vif-plugged", "status": "completed", "tag": "380031c9-b01e-4d04-9d20-1e65825341f8"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:45:23.496366 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-a3ad6a79-0dae-4318-a4ce-101f49ce4c1c req-3bb34958-b0c9-46d8-8a63-1266d2e45ad8 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:23.496852 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-a3ad6a79-0dae-4318-a4ce-101f49ce4c1c req-3bb34958-b0c9-46d8-8a63-1266d2e45ad8 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:23.497563 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-a3ad6a79-0dae-4318-a4ce-101f49ce4c1c req-3bb34958-b0c9-46d8-8a63-1266d2e45ad8 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:23.509147 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-a3ad6a79-0dae-4318-a4ce-101f49ce4c1c req-3bb34958-b0c9-46d8-8a63-1266d2e45ad8 service nova] Creating event network-vif-plugged:380031c9-b01e-4d04-9d20-1e65825341f8 for instance 76985445-294d-45f5-9f95-40951eed1555 on hv-cinder-85069 Aug 17 19:45:23.514151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-a3ad6a79-0dae-4318-a4ce-101f49ce4c1c req-3bb34958-b0c9-46d8-8a63-1266d2e45ad8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033984 Aug 17 19:45:23.514758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 371/745] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:45:23.934085 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-fbffa642-1315-4dfe-9245-e027eb2df91f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:23.934701 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-fbffa642-1315-4dfe-9245-e027eb2df91f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:23.941724 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fbffa642-1315-4dfe-9245-e027eb2df91f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:23.943102 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fbffa642-1315-4dfe-9245-e027eb2df91f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:23.943102 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fbffa642-1315-4dfe-9245-e027eb2df91f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:23.943377 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fbffa642-1315-4dfe-9245-e027eb2df91f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:23.943831 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fbffa642-1315-4dfe-9245-e027eb2df91f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:23.944254 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-fbffa642-1315-4dfe-9245-e027eb2df91f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:24.090193 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-fbffa642-1315-4dfe-9245-e027eb2df91f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:24.098856 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-fbffa642-1315-4dfe-9245-e027eb2df91f tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1575 microversion: 2.1 time: 0.168330 Aug 17 19:45:24.106099 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 375/746] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:23 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:25.120645 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ee188627-f2d3-4e60-8c9f-3190e0996c27 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:25.121373 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ee188627-f2d3-4e60-8c9f-3190e0996c27 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:25.127572 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ee188627-f2d3-4e60-8c9f-3190e0996c27 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:25.128055 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ee188627-f2d3-4e60-8c9f-3190e0996c27 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:25.128490 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ee188627-f2d3-4e60-8c9f-3190e0996c27 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:25.129181 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ee188627-f2d3-4e60-8c9f-3190e0996c27 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:25.129676 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ee188627-f2d3-4e60-8c9f-3190e0996c27 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:25.130096 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ee188627-f2d3-4e60-8c9f-3190e0996c27 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:25.266012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ee188627-f2d3-4e60-8c9f-3190e0996c27 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:25.268756 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:45:25.276532 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ee188627-f2d3-4e60-8c9f-3190e0996c27 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1562 microversion: 2.1 time: 0.160546 Aug 17 19:45:25.277046 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 372/747] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:25 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:30.495754 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ebed2afd-8792-41a2-8e47-b7bdcb7a0c9f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: .version_select at 0x7f3689f28940>, body: {"keypair": {"name": "tempest-keypair-551965545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfr5O1YeFoFLXgSolrtJWjkELnjuJQiF+Kx+XDZl7FszawwiG++FiFMfZPJpvxMmXqyez/bajGyIg8P/fpW3k69/3IoDK+XDBCbcwfMp3ZlMucRJkFPlWQo8l5o5eKGRQ=="}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:45:30.511701 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-ebed2afd-8792-41a2-8e47-b7bdcb7a0c9f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for project d48524fb6ff040dcac98b23363268772. Resources: {'key_pairs'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:45:30.515756 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-ebed2afd-8792-41a2-8e47-b7bdcb7a0c9f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for user 22406c8108a4408aa39c5d174d032e20 and project d48524fb6ff040dcac98b23363268772. Resources: {'key_pairs'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:45:30.538196 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ebed2afd-8792-41a2-8e47-b7bdcb7a0c9f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157901 Aug 17 19:45:30.538861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 376/748] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 17 19:45:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:45:32.253793 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-331621868", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04936ff2-1cb2-462b-9dfb-59deb589561c"}], "security_groups": [{"name": "tempest-securitygroup--2135188536"}], "key_name": "tempest-keypair-551965545", "user_data": "}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:45:32.361780 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.network.neutron [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] validate_networks() for [('04936ff2-1cb2-462b-9dfb-59deb589561c', None, None, None, None, None)] {{(pid=132530) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:45:32.782771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Flavor limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:45:32.783191 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Image limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:45:32.783659 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Flavor pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:45:32.784101 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Image pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:45:32.784511 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:45:32.796474 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:32.797174 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:32.797809 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:32.798832 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:32.799445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:32.800041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:32.819358 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for project d48524fb6ff040dcac98b23363268772. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:45:32.823202 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for user 22406c8108a4408aa39c5d174d032e20 and project d48524fb6ff040dcac98b23363268772. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:45:32.834527 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Going to run 1 instances... {{(pid=132530) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:45:32.836783 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132530) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:45:32.887071 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-34bcb1df-5ab5-4146-a172-35569a156682 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.638152 Aug 17 19:45:32.888008 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 373/749] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:45:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:45:32.899882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-66f9f681-bbe7-4784-89cd-d03c66909409 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:32.901043 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-66f9f681-bbe7-4784-89cd-d03c66909409 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:32.975477 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-66f9f681-bbe7-4784-89cd-d03c66909409 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:32.983358 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-66f9f681-bbe7-4784-89cd-d03c66909409 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1240 microversion: 2.1 time: 0.087741 Aug 17 19:45:32.996662 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 377/750] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:32 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1240 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:34.007945 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-aba58fb3-3102-4762-b1be-41d1203686b3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:34.008419 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-aba58fb3-3102-4762-b1be-41d1203686b3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:34.018256 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aba58fb3-3102-4762-b1be-41d1203686b3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:34.019012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aba58fb3-3102-4762-b1be-41d1203686b3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:34.019597 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aba58fb3-3102-4762-b1be-41d1203686b3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:34.020822 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aba58fb3-3102-4762-b1be-41d1203686b3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:34.021711 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aba58fb3-3102-4762-b1be-41d1203686b3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:34.022288 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aba58fb3-3102-4762-b1be-41d1203686b3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:34.089310 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c0f8c6bc-cea0-4706-a217-46745cde41f8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:34.092026 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-c0f8c6bc-cea0-4706-a217-46745cde41f8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:34.094543 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=46 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:45:34.109799 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c0f8c6bc-cea0-4706-a217-46745cde41f8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:34.110295 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c0f8c6bc-cea0-4706-a217-46745cde41f8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:34.110738 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c0f8c6bc-cea0-4706-a217-46745cde41f8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:34.111446 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c0f8c6bc-cea0-4706-a217-46745cde41f8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:34.111908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c0f8c6bc-cea0-4706-a217-46745cde41f8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:34.112338 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c0f8c6bc-cea0-4706-a217-46745cde41f8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:34.126439 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-aba58fb3-3102-4762-b1be-41d1203686b3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:34.137422 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-aba58fb3-3102-4762-b1be-41d1203686b3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1298 microversion: 2.1 time: 0.135278 Aug 17 19:45:34.139010 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 374/751] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:34 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1298 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:34.168146 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-c0f8c6bc-cea0-4706-a217-46745cde41f8 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.082745 Aug 17 19:45:34.169680 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 378/752] 10.222.0.59 () {60 vars in 1343 bytes} [Wed Aug 17 19:45:34 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:45:34.238456 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-dcce7c27-74fa-4f0a-9fc1-817baf987e4b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:34.238806 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-dcce7c27-74fa-4f0a-9fc1-817baf987e4b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:34.244782 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dcce7c27-74fa-4f0a-9fc1-817baf987e4b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:34.245366 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dcce7c27-74fa-4f0a-9fc1-817baf987e4b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:34.245864 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dcce7c27-74fa-4f0a-9fc1-817baf987e4b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:34.246631 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dcce7c27-74fa-4f0a-9fc1-817baf987e4b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:34.247147 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dcce7c27-74fa-4f0a-9fc1-817baf987e4b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:34.247630 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-dcce7c27-74fa-4f0a-9fc1-817baf987e4b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:34.272437 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-dcce7c27-74fa-4f0a-9fc1-817baf987e4b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Going to try to terminate instance {{(pid=132530) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:45:34.352152 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-dcce7c27-74fa-4f0a-9fc1-817baf987e4b tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 204 len: 0 microversion: 2.20 time: 0.118571 Aug 17 19:45:34.353278 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 375/753] 10.222.0.59 () {60 vars in 1280 bytes} [Wed Aug 17 19:45:34 2022] DELETE /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 19:45:34.361781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a337d5ae-68cd-4271-bf7a-9224e8a814cc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:34.362501 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a337d5ae-68cd-4271-bf7a-9224e8a814cc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:34.368632 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a337d5ae-68cd-4271-bf7a-9224e8a814cc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:34.369120 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a337d5ae-68cd-4271-bf7a-9224e8a814cc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:34.369609 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a337d5ae-68cd-4271-bf7a-9224e8a814cc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:34.370328 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a337d5ae-68cd-4271-bf7a-9224e8a814cc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:34.370780 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a337d5ae-68cd-4271-bf7a-9224e8a814cc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:34.371197 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a337d5ae-68cd-4271-bf7a-9224e8a814cc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:34.502428 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a337d5ae-68cd-4271-bf7a-9224e8a814cc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:34.510359 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a337d5ae-68cd-4271-bf7a-9224e8a814cc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:34.511837 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a337d5ae-68cd-4271-bf7a-9224e8a814cc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:34.512973 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a337d5ae-68cd-4271-bf7a-9224e8a814cc tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1722 microversion: 2.20 time: 0.155523 Aug 17 19:45:34.513554 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 379/754] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:45:34 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:45:35.159678 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-0f126a13-4f0e-4dcf-96b0-13db33dc74f7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:35.160373 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-0f126a13-4f0e-4dcf-96b0-13db33dc74f7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:35.166668 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0f126a13-4f0e-4dcf-96b0-13db33dc74f7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:35.167145 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0f126a13-4f0e-4dcf-96b0-13db33dc74f7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:35.167575 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0f126a13-4f0e-4dcf-96b0-13db33dc74f7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:35.168259 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0f126a13-4f0e-4dcf-96b0-13db33dc74f7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:35.168716 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0f126a13-4f0e-4dcf-96b0-13db33dc74f7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:35.169138 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0f126a13-4f0e-4dcf-96b0-13db33dc74f7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:35.305909 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0f126a13-4f0e-4dcf-96b0-13db33dc74f7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:35.313254 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-0f126a13-4f0e-4dcf-96b0-13db33dc74f7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1366 microversion: 2.1 time: 0.157840 Aug 17 19:45:35.313813 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 376/755] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:35 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:35.535980 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-cc8e8c8f-af03-46df-a2fe-da4fa5a91a71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:35.537181 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-cc8e8c8f-af03-46df-a2fe-da4fa5a91a71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:35.543607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-cc8e8c8f-af03-46df-a2fe-da4fa5a91a71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:35.544089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-cc8e8c8f-af03-46df-a2fe-da4fa5a91a71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:35.544525 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-cc8e8c8f-af03-46df-a2fe-da4fa5a91a71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:35.545232 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-cc8e8c8f-af03-46df-a2fe-da4fa5a91a71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:35.546203 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-cc8e8c8f-af03-46df-a2fe-da4fa5a91a71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:35.546624 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-cc8e8c8f-af03-46df-a2fe-da4fa5a91a71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:35.692431 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-cc8e8c8f-af03-46df-a2fe-da4fa5a91a71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:35.701725 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-cc8e8c8f-af03-46df-a2fe-da4fa5a91a71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:35.703531 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-cc8e8c8f-af03-46df-a2fe-da4fa5a91a71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:35.706056 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-cc8e8c8f-af03-46df-a2fe-da4fa5a91a71 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1722 microversion: 2.20 time: 0.173736 Aug 17 19:45:35.706847 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 380/756] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:45:35 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:45:36.334421 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-fa7920ab-6b47-406f-a123-6392eea87f72 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:36.334883 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-fa7920ab-6b47-406f-a123-6392eea87f72 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:36.341531 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa7920ab-6b47-406f-a123-6392eea87f72 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:36.342023 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa7920ab-6b47-406f-a123-6392eea87f72 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:36.343074 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa7920ab-6b47-406f-a123-6392eea87f72 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:36.343842 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa7920ab-6b47-406f-a123-6392eea87f72 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:36.344297 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa7920ab-6b47-406f-a123-6392eea87f72 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:36.344775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fa7920ab-6b47-406f-a123-6392eea87f72 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:36.347937 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-a92de54b-14e4-46e0-afc1-48e29c055440 req-4914e8cf-91d4-4e4a-820d-30a87aab9c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78428449-8788-42ec-bdb0-1ee8723c3ea3", "tag": "4ec02703-f8ea-4535-b9ae-1509e13b37e5"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:45:36.359531 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-a92de54b-14e4-46e0-afc1-48e29c055440 req-4914e8cf-91d4-4e4a-820d-30a87aab9c94 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:36.360071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-a92de54b-14e4-46e0-afc1-48e29c055440 req-4914e8cf-91d4-4e4a-820d-30a87aab9c94 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:36.360605 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-a92de54b-14e4-46e0-afc1-48e29c055440 req-4914e8cf-91d4-4e4a-820d-30a87aab9c94 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:36.383061 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-a92de54b-14e4-46e0-afc1-48e29c055440 req-4914e8cf-91d4-4e4a-820d-30a87aab9c94 service nova] Creating event network-changed:4ec02703-f8ea-4535-b9ae-1509e13b37e5 for instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 on hv-cinder-85069 Aug 17 19:45:36.388813 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-a92de54b-14e4-46e0-afc1-48e29c055440 req-4914e8cf-91d4-4e4a-820d-30a87aab9c94 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046207 Aug 17 19:45:36.391290 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 381/757] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:45:36.482511 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-fa7920ab-6b47-406f-a123-6392eea87f72 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:36.490228 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-fa7920ab-6b47-406f-a123-6392eea87f72 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1366 microversion: 2.1 time: 0.160034 Aug 17 19:45:36.490804 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 377/758] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:36 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:36.730901 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-06a68a8f-9690-4ddc-84f0-bb05de83b5b9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:36.731650 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-06a68a8f-9690-4ddc-84f0-bb05de83b5b9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:36.737734 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-06a68a8f-9690-4ddc-84f0-bb05de83b5b9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:36.738210 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-06a68a8f-9690-4ddc-84f0-bb05de83b5b9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:36.738651 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-06a68a8f-9690-4ddc-84f0-bb05de83b5b9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:36.739322 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-06a68a8f-9690-4ddc-84f0-bb05de83b5b9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:36.739766 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-06a68a8f-9690-4ddc-84f0-bb05de83b5b9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:36.740183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-06a68a8f-9690-4ddc-84f0-bb05de83b5b9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:36.808086 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-06a68a8f-9690-4ddc-84f0-bb05de83b5b9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:36.817506 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-06a68a8f-9690-4ddc-84f0-bb05de83b5b9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:36.819792 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-06a68a8f-9690-4ddc-84f0-bb05de83b5b9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:36.821126 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-06a68a8f-9690-4ddc-84f0-bb05de83b5b9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1655 microversion: 2.20 time: 0.094683 Aug 17 19:45:36.822382 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 382/759] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:45:36 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1655 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:45:37.510772 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ac79af47-4232-4f61-926e-e2d0cc070776 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:37.511987 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ac79af47-4232-4f61-926e-e2d0cc070776 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:37.518491 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ac79af47-4232-4f61-926e-e2d0cc070776 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:37.518975 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ac79af47-4232-4f61-926e-e2d0cc070776 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:37.519411 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ac79af47-4232-4f61-926e-e2d0cc070776 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:37.520108 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ac79af47-4232-4f61-926e-e2d0cc070776 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:37.520558 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ac79af47-4232-4f61-926e-e2d0cc070776 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:37.520983 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ac79af47-4232-4f61-926e-e2d0cc070776 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:37.655654 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ac79af47-4232-4f61-926e-e2d0cc070776 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:37.664155 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ac79af47-4232-4f61-926e-e2d0cc070776 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1366 microversion: 2.1 time: 0.157148 Aug 17 19:45:37.664736 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 378/760] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:37 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:37.860327 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:37.865408 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:37.877405 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:37.877977 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:37.878490 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:37.879226 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:37.879697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:37.880103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:37.926376 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:37.926909 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:37.927322 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:37.927779 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.objects.instance [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lazy-loading 'fault' on Instance uuid 1cba8eae-5542-4c28-b8fa-79e93d2f0959 {{(pid=132531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:45:37.978154 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:37.985972 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:37.987562 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a569e6174a7c4a1887bd292e3c06df89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e6832c3bb274bb1bdfd27ca3869f8cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:37.988649 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b37f42f2-0176-4fc7-8e2e-f9cead9e4c19 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 200 len: 1372 microversion: 2.20 time: 0.146288 Aug 17 19:45:37.989205 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 383/761] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:45:37 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 19:45:38.442755 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-b292c21e-3c5a-474b-9f0c-37223ce0f4e2 req-75a7f90b-54a2-4683-b938-17c06779f9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cba8eae-5542-4c28-b8fa-79e93d2f0959", "name": "network-vif-deleted", "tag": "d7eda5e9-6550-4d73-bb9c-c6d74429a2d5"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:45:38.452622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-b292c21e-3c5a-474b-9f0c-37223ce0f4e2 req-75a7f90b-54a2-4683-b938-17c06779f9d5 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:38.453271 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-b292c21e-3c5a-474b-9f0c-37223ce0f4e2 req-75a7f90b-54a2-4683-b938-17c06779f9d5 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:38.453718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-b292c21e-3c5a-474b-9f0c-37223ce0f4e2 req-75a7f90b-54a2-4683-b938-17c06779f9d5 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:38.464305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-b292c21e-3c5a-474b-9f0c-37223ce0f4e2 req-75a7f90b-54a2-4683-b938-17c06779f9d5 service nova] Creating event network-vif-deleted:d7eda5e9-6550-4d73-bb9c-c6d74429a2d5 for instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 on hv-cinder-85069 Aug 17 19:45:38.469790 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-b292c21e-3c5a-474b-9f0c-37223ce0f4e2 req-75a7f90b-54a2-4683-b938-17c06779f9d5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030644 Aug 17 19:45:38.470371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 379/762] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:45:38.685195 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3266691a-c869-4641-b99e-6ed48ba6d7cc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:38.685826 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3266691a-c869-4641-b99e-6ed48ba6d7cc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:38.691736 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3266691a-c869-4641-b99e-6ed48ba6d7cc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:38.692212 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3266691a-c869-4641-b99e-6ed48ba6d7cc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:38.692647 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3266691a-c869-4641-b99e-6ed48ba6d7cc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:38.693360 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3266691a-c869-4641-b99e-6ed48ba6d7cc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:38.693819 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3266691a-c869-4641-b99e-6ed48ba6d7cc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:38.694239 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3266691a-c869-4641-b99e-6ed48ba6d7cc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:38.830835 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3266691a-c869-4641-b99e-6ed48ba6d7cc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:38.838155 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3266691a-c869-4641-b99e-6ed48ba6d7cc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1366 microversion: 2.1 time: 0.156822 Aug 17 19:45:38.838718 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 384/763] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:38 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:39.012259 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-52f2c0e8-1ff3-4670-9884-0ad96b809a56 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:39.012890 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-52f2c0e8-1ff3-4670-9884-0ad96b809a56 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:39.019578 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-52f2c0e8-1ff3-4670-9884-0ad96b809a56 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:39.020098 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-52f2c0e8-1ff3-4670-9884-0ad96b809a56 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:39.020533 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-52f2c0e8-1ff3-4670-9884-0ad96b809a56 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:39.021234 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-52f2c0e8-1ff3-4670-9884-0ad96b809a56 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:39.021701 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-52f2c0e8-1ff3-4670-9884-0ad96b809a56 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:39.022128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-52f2c0e8-1ff3-4670-9884-0ad96b809a56 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:39.035039 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-52f2c0e8-1ff3-4670-9884-0ad96b809a56 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] HTTP exception thrown: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-52f2c0e8-1ff3-4670-9884-0ad96b809a56 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Request method failure captured: Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 HTTP/1.1 Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPfdck5vJBZ_LDqwcb_PdFyHuPLsXQceEuNWoFSZEHuREr5vi4FpE69x1wZXW5Tc0-TLNDLhhzyPQt7W77VgnSGhwGrUnU8JYl6Ebd6TR-EjsZT8reOeJaWkeaq72q12YuqfGHPFTr2ms5BjfStN2M5DtgLFZ8b9JUzSp8AX3R2s30 Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: 5e6832c3bb274bb1bdfd27ca3869f8cd Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:45:39.036622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:45:39.038246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5e6832c3bb274bb1bdfd27ca3869f8cd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}] Aug 17 19:45:39.038246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:39.038246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: 5e6832c3bb274bb1bdfd27ca3869f8cd Aug 17 19:45:39.038246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:39.038246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeShelveTestJSON-1724157338-project Aug 17 19:45:39.038246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:45:39.038246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:45:39.038246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: a569e6174a7c4a1887bd292e3c06df89 Aug 17 19:45:39.038246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1724157338-project Aug 17 19:45:39.038246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:45:39.038246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:39.038246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '1cba8eae-5542-4c28-b8fa-79e93d2f0959'} Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:45:39.039144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:39.040603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:39.042044 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-52f2c0e8-1ff3-4670-9884-0ad96b809a56 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Returning 404 to user: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:45:39.042044 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-52f2c0e8-1ff3-4670-9884-0ad96b809a56 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 404 len: 111 microversion: 2.20 time: 0.030564 Aug 17 19:45:39.042044 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 380/764] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:45:39 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 19:45:39.046941 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-da6b6363-824a-4761-8101-b531789c5608 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '.version_select at 0x7f3689e905e0>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:39.065450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-da6b6363-824a-4761-8101-b531789c5608 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587301655" status: 204 len: 0 microversion: 2.20 time: 0.022211 Aug 17 19:45:39.065991 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 385/765] 10.222.0.59 () {60 vars in 1262 bytes} [Wed Aug 17 19:45:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587301655 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 17 19:45:39.859988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-bf2f0a4b-d3b6-40cf-bd2f-0daa067cbce2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:39.860622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-bf2f0a4b-d3b6-40cf-bd2f-0daa067cbce2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:39.866533 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bf2f0a4b-d3b6-40cf-bd2f-0daa067cbce2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:39.867043 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bf2f0a4b-d3b6-40cf-bd2f-0daa067cbce2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:39.867459 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bf2f0a4b-d3b6-40cf-bd2f-0daa067cbce2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:39.868153 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bf2f0a4b-d3b6-40cf-bd2f-0daa067cbce2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:39.868607 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bf2f0a4b-d3b6-40cf-bd2f-0daa067cbce2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:39.869032 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bf2f0a4b-d3b6-40cf-bd2f-0daa067cbce2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:40.005605 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-bf2f0a4b-d3b6-40cf-bd2f-0daa067cbce2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:40.013193 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-bf2f0a4b-d3b6-40cf-bd2f-0daa067cbce2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1366 microversion: 2.1 time: 0.157697 Aug 17 19:45:40.013816 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 381/766] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:39 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:40.813122 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-915ef369-4c0a-42b9-a03b-9455e577e3c9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:40.813662 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-915ef369-4c0a-42b9-a03b-9455e577e3c9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:40.820362 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-915ef369-4c0a-42b9-a03b-9455e577e3c9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:40.820848 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-915ef369-4c0a-42b9-a03b-9455e577e3c9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:40.821322 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-915ef369-4c0a-42b9-a03b-9455e577e3c9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:40.822010 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-915ef369-4c0a-42b9-a03b-9455e577e3c9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:40.822466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-915ef369-4c0a-42b9-a03b-9455e577e3c9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:40.822889 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-915ef369-4c0a-42b9-a03b-9455e577e3c9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:40.835955 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-915ef369-4c0a-42b9-a03b-9455e577e3c9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] HTTP exception thrown: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-915ef369-4c0a-42b9-a03b-9455e577e3c9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Request method failure captured: Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: DELETE /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 HTTP/1.1 Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPfdck5vJBZ_LDqwcb_PdFyHuPLsXQceEuNWoFSZEHuREr5vi4FpE69x1wZXW5Tc0-TLNDLhhzyPQt7W77VgnSGhwGrUnU8JYl6Ebd6TR-EjsZT8reOeJaWkeaq72q12YuqfGHPFTr2ms5BjfStN2M5DtgLFZ8b9JUzSp8AX3R2s30 Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 5e6832c3bb274bb1bdfd27ca3869f8cd Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:45:40.837601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:45:40.839175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5e6832c3bb274bb1bdfd27ca3869f8cd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}] Aug 17 19:45:40.839175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:40.839175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 5e6832c3bb274bb1bdfd27ca3869f8cd Aug 17 19:45:40.839175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:40.839175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-AttachVolumeShelveTestJSON-1724157338-project Aug 17 19:45:40.839175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:45:40.839175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:45:40.839175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: a569e6174a7c4a1887bd292e3c06df89 Aug 17 19:45:40.839175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1724157338-project Aug 17 19:45:40.839175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:45:40.839175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:40.839175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '1cba8eae-5542-4c28-b8fa-79e93d2f0959'} Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:45:40.840029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:40.841615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:40.843572 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-915ef369-4c0a-42b9-a03b-9455e577e3c9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Returning 404 to user: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:45:40.843572 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-915ef369-4c0a-42b9-a03b-9455e577e3c9 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 404 len: 111 microversion: 2.20 time: 0.030988 Aug 17 19:45:40.843572 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 386/767] 10.222.0.59 () {60 vars in 1280 bytes} [Wed Aug 17 19:45:40 2022] DELETE /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 19:45:40.847856 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f446f822-ba2b-4e64-86e4-d2cb22e33f55 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:40.848498 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f446f822-ba2b-4e64-86e4-d2cb22e33f55 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: 1cba8eae-5542-4c28-b8fa-79e93d2f0959] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:40.854425 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f446f822-ba2b-4e64-86e4-d2cb22e33f55 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:40.854911 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f446f822-ba2b-4e64-86e4-d2cb22e33f55 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:40.855487 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f446f822-ba2b-4e64-86e4-d2cb22e33f55 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:40.856176 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f446f822-ba2b-4e64-86e4-d2cb22e33f55 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:40.856634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f446f822-ba2b-4e64-86e4-d2cb22e33f55 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:40.857061 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f446f822-ba2b-4e64-86e4-d2cb22e33f55 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:40.870618 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-f446f822-ba2b-4e64-86e4-d2cb22e33f55 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] HTTP exception thrown: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f446f822-ba2b-4e64-86e4-d2cb22e33f55 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Request method failure captured: Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 HTTP/1.1 Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPfdck5vJBZ_LDqwcb_PdFyHuPLsXQceEuNWoFSZEHuREr5vi4FpE69x1wZXW5Tc0-TLNDLhhzyPQt7W77VgnSGhwGrUnU8JYl6Ebd6TR-EjsZT8reOeJaWkeaq72q12YuqfGHPFTr2ms5BjfStN2M5DtgLFZ8b9JUzSp8AX3R2s30 Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: 5e6832c3bb274bb1bdfd27ca3869f8cd Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:45:40.872128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:45:40.874370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5e6832c3bb274bb1bdfd27ca3869f8cd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}] Aug 17 19:45:40.874370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:40.874370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: 5e6832c3bb274bb1bdfd27ca3869f8cd Aug 17 19:45:40.874370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:40.874370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeShelveTestJSON-1724157338-project Aug 17 19:45:40.874370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:45:40.874370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:45:40.874370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: a569e6174a7c4a1887bd292e3c06df89 Aug 17 19:45:40.874370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1724157338-project Aug 17 19:45:40.874370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:45:40.874370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:40.874370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '1cba8eae-5542-4c28-b8fa-79e93d2f0959'} Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:45:40.875371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. Aug 17 19:45:40.876773 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:40.878143 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f446f822-ba2b-4e64-86e4-d2cb22e33f55 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Returning 404 to user: Instance 1cba8eae-5542-4c28-b8fa-79e93d2f0959 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:45:40.878143 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f446f822-ba2b-4e64-86e4-d2cb22e33f55 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959" status: 404 len: 111 microversion: 2.20 time: 0.029482 Aug 17 19:45:40.878143 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 382/768] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:45:40 2022] GET /compute/v2.1/servers/1cba8eae-5542-4c28-b8fa-79e93d2f0959 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 19:45:41.033704 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5ccbf16c-7570-4aa9-ac1d-85553914ea49 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:41.034339 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5ccbf16c-7570-4aa9-ac1d-85553914ea49 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:41.040321 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ccbf16c-7570-4aa9-ac1d-85553914ea49 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:41.040733 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ccbf16c-7570-4aa9-ac1d-85553914ea49 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:41.041163 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ccbf16c-7570-4aa9-ac1d-85553914ea49 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:41.042033 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ccbf16c-7570-4aa9-ac1d-85553914ea49 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:41.042588 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ccbf16c-7570-4aa9-ac1d-85553914ea49 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:41.043008 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ccbf16c-7570-4aa9-ac1d-85553914ea49 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:41.181933 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5ccbf16c-7570-4aa9-ac1d-85553914ea49 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:41.190041 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5ccbf16c-7570-4aa9-ac1d-85553914ea49 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1366 microversion: 2.1 time: 0.160149 Aug 17 19:45:41.190594 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 387/769] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:41 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:41.544246 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-1c425c2d-efdf-484a-a5b4-10c157c029a9 req-66d7583d-a726-40f3-b818-85123dcaff02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78428449-8788-42ec-bdb0-1ee8723c3ea3", "name": "network-vif-plugged", "status": "completed", "tag": "4ec02703-f8ea-4535-b9ae-1509e13b37e5"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:45:41.554389 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-1c425c2d-efdf-484a-a5b4-10c157c029a9 req-66d7583d-a726-40f3-b818-85123dcaff02 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:41.554872 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-1c425c2d-efdf-484a-a5b4-10c157c029a9 req-66d7583d-a726-40f3-b818-85123dcaff02 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:41.555304 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-1c425c2d-efdf-484a-a5b4-10c157c029a9 req-66d7583d-a726-40f3-b818-85123dcaff02 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:41.566778 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-1c425c2d-efdf-484a-a5b4-10c157c029a9 req-66d7583d-a726-40f3-b818-85123dcaff02 service nova] Creating event network-vif-plugged:4ec02703-f8ea-4535-b9ae-1509e13b37e5 for instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 on hv-cinder-85069 Aug 17 19:45:41.571500 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-1c425c2d-efdf-484a-a5b4-10c157c029a9 req-66d7583d-a726-40f3-b818-85123dcaff02 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030900 Aug 17 19:45:41.572079 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 383/770] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:45:42.012540 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c6e40cc2-bcd2-4682-a350-5519c6dc70a2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:42.013029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-c6e40cc2-bcd2-4682-a350-5519c6dc70a2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:42.020081 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c6e40cc2-bcd2-4682-a350-5519c6dc70a2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:42.020554 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c6e40cc2-bcd2-4682-a350-5519c6dc70a2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:42.021099 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c6e40cc2-bcd2-4682-a350-5519c6dc70a2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:42.021809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c6e40cc2-bcd2-4682-a350-5519c6dc70a2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:42.022261 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c6e40cc2-bcd2-4682-a350-5519c6dc70a2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:42.022679 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c6e40cc2-bcd2-4682-a350-5519c6dc70a2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:42.035592 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-c6e40cc2-bcd2-4682-a350-5519c6dc70a2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] HTTP exception thrown: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c6e40cc2-bcd2-4682-a350-5519c6dc70a2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Request method failure captured: Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: DELETE /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 HTTP/1.1 Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UPfdck5vJBZ_LDqwcb_PdFyHuPLsXQceEuNWoFSZEHuREr5vi4FpE69x1wZXW5Tc0-TLNDLhhzyPQt7W77VgnSGhwGrUnU8JYl6Ebd6TR-EjsZT8reOeJaWkeaq72q12YuqfGHPFTr2ms5BjfStN2M5DtgLFZ8b9JUzSp8AX3R2s30 Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 5e6832c3bb274bb1bdfd27ca3869f8cd Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:45:42.037103 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:45:42.038744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5e6832c3bb274bb1bdfd27ca3869f8cd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}] Aug 17 19:45:42.038744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:42.038744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 5e6832c3bb274bb1bdfd27ca3869f8cd Aug 17 19:45:42.038744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:42.038744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-AttachVolumeShelveTestJSON-1724157338-project Aug 17 19:45:42.038744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:45:42.038744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:45:42.038744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: a569e6174a7c4a1887bd292e3c06df89 Aug 17 19:45:42.038744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1724157338-project Aug 17 19:45:42.038744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:45:42.038744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:45:42.038744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': 'b04daa67-36a6-4a53-b80a-e90f77348028'} Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:45:42.039861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:45:42.041325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:45:42.042777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c6e40cc2-bcd2-4682-a350-5519c6dc70a2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Returning 404 to user: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:45:42.042777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-c6e40cc2-bcd2-4682-a350-5519c6dc70a2 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 404 len: 111 microversion: 2.20 time: 0.029768 Aug 17 19:45:42.042777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 388/771] 10.222.0.59 () {60 vars in 1280 bytes} [Wed Aug 17 19:45:42 2022] DELETE /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 19:45:42.047603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-58a98429-a8af-42ba-95c4-507707749cf6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:42.048333 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-58a98429-a8af-42ba-95c4-507707749cf6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] [instance: b04daa67-36a6-4a53-b80a-e90f77348028] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:42.054446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-58a98429-a8af-42ba-95c4-507707749cf6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:42.054928 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-58a98429-a8af-42ba-95c4-507707749cf6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:42.055368 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-58a98429-a8af-42ba-95c4-507707749cf6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:42.056062 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-58a98429-a8af-42ba-95c4-507707749cf6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:42.056526 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-58a98429-a8af-42ba-95c4-507707749cf6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:42.056945 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-58a98429-a8af-42ba-95c4-507707749cf6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:42.070156 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-58a98429-a8af-42ba-95c4-507707749cf6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] HTTP exception thrown: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-58a98429-a8af-42ba-95c4-507707749cf6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Request method failure captured: Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 HTTP/1.1 Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UPfdck5vJBZ_LDqwcb_PdFyHuPLsXQceEuNWoFSZEHuREr5vi4FpE69x1wZXW5Tc0-TLNDLhhzyPQt7W77VgnSGhwGrUnU8JYl6Ebd6TR-EjsZT8reOeJaWkeaq72q12YuqfGHPFTr2ms5BjfStN2M5DtgLFZ8b9JUzSp8AX3R2s30 Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: 5e6832c3bb274bb1bdfd27ca3869f8cd Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:45:42.071725 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:45:42.073351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5e6832c3bb274bb1bdfd27ca3869f8cd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5e6832c3bb274bb1bdfd27ca3869f8cd"}]}] Aug 17 19:45:42.073351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:42.073351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: 5e6832c3bb274bb1bdfd27ca3869f8cd Aug 17 19:45:42.073351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1724157338 Aug 17 19:45:42.073351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeShelveTestJSON-1724157338-project Aug 17 19:45:42.073351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:45:42.073351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:45:42.073351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: a569e6174a7c4a1887bd292e3c06df89 Aug 17 19:45:42.073351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1724157338-project Aug 17 19:45:42.073351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:45:42.073351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:45:42.073351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': 'b04daa67-36a6-4a53-b80a-e90f77348028'} Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:45:42.074549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. Aug 17 19:45:42.075758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:45:42.077633 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-58a98429-a8af-42ba-95c4-507707749cf6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] Returning 404 to user: Instance b04daa67-36a6-4a53-b80a-e90f77348028 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:45:42.077633 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-58a98429-a8af-42ba-95c4-507707749cf6 tempest-AttachVolumeShelveTestJSON-1724157338 tempest-AttachVolumeShelveTestJSON-1724157338-project] 10.222.0.59 "GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028" status: 404 len: 111 microversion: 2.20 time: 0.029835 Aug 17 19:45:42.077633 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 384/772] 10.222.0.59 () {60 vars in 1277 bytes} [Wed Aug 17 19:45:42 2022] GET /compute/v2.1/servers/b04daa67-36a6-4a53-b80a-e90f77348028 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 19:45:42.210649 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a2d73c94-99bd-4838-8ca7-33582272f9eb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:42.211327 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a2d73c94-99bd-4838-8ca7-33582272f9eb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:42.217284 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2d73c94-99bd-4838-8ca7-33582272f9eb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:42.217773 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2d73c94-99bd-4838-8ca7-33582272f9eb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:42.218215 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2d73c94-99bd-4838-8ca7-33582272f9eb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:42.218906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2d73c94-99bd-4838-8ca7-33582272f9eb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:42.219362 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2d73c94-99bd-4838-8ca7-33582272f9eb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:42.219788 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2d73c94-99bd-4838-8ca7-33582272f9eb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:42.349311 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a2d73c94-99bd-4838-8ca7-33582272f9eb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:42.357053 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a2d73c94-99bd-4838-8ca7-33582272f9eb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1366 microversion: 2.1 time: 0.150267 Aug 17 19:45:42.358582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 389/773] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:42 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:43.380867 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3cb56b82-067c-4fd2-95e6-febfb894e2b0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:43.382058 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3cb56b82-067c-4fd2-95e6-febfb894e2b0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:43.385936 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:45:43.386842 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=6 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:45:43.391762 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3cb56b82-067c-4fd2-95e6-febfb894e2b0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:43.392249 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3cb56b82-067c-4fd2-95e6-febfb894e2b0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:43.392686 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3cb56b82-067c-4fd2-95e6-febfb894e2b0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:43.393442 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3cb56b82-067c-4fd2-95e6-febfb894e2b0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:43.393903 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3cb56b82-067c-4fd2-95e6-febfb894e2b0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:43.394329 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3cb56b82-067c-4fd2-95e6-febfb894e2b0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:43.527330 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3cb56b82-067c-4fd2-95e6-febfb894e2b0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:45:43.535534 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3cb56b82-067c-4fd2-95e6-febfb894e2b0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1556 microversion: 2.1 time: 0.159429 Aug 17 19:45:43.536310 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 385/774] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:45:43 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:45:43.557247 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f1b3bf33-784a-412a-92a0-38b1ba2effe3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:45:43.558413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f1b3bf33-784a-412a-92a0-38b1ba2effe3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:45:43.560483 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=6 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:45:43.566341 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1b3bf33-784a-412a-92a0-38b1ba2effe3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:43.566830 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1b3bf33-784a-412a-92a0-38b1ba2effe3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:43.567264 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1b3bf33-784a-412a-92a0-38b1ba2effe3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:43.567967 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1b3bf33-784a-412a-92a0-38b1ba2effe3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:43.568424 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1b3bf33-784a-412a-92a0-38b1ba2effe3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:43.568880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f1b3bf33-784a-412a-92a0-38b1ba2effe3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:43.646660 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f1b3bf33-784a-412a-92a0-38b1ba2effe3 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093354 Aug 17 19:45:43.647332 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 390/775] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 17 19:45:43 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:45:44.723472 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-bdd21534-e6dd-4f25-8e01-8019b45bd9fa req-477ad0d4-a6eb-421d-89ad-b126d1aa1ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78428449-8788-42ec-bdb0-1ee8723c3ea3", "tag": "4ec02703-f8ea-4535-b9ae-1509e13b37e5"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:45:44.733566 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-bdd21534-e6dd-4f25-8e01-8019b45bd9fa req-477ad0d4-a6eb-421d-89ad-b126d1aa1ea1 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:45:44.734306 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-bdd21534-e6dd-4f25-8e01-8019b45bd9fa req-477ad0d4-a6eb-421d-89ad-b126d1aa1ea1 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:45:44.734727 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-bdd21534-e6dd-4f25-8e01-8019b45bd9fa req-477ad0d4-a6eb-421d-89ad-b126d1aa1ea1 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:45:44.751758 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-bdd21534-e6dd-4f25-8e01-8019b45bd9fa req-477ad0d4-a6eb-421d-89ad-b126d1aa1ea1 service nova] Creating event network-changed:4ec02703-f8ea-4535-b9ae-1509e13b37e5 for instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 on hv-cinder-85069 Aug 17 19:45:44.756769 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-bdd21534-e6dd-4f25-8e01-8019b45bd9fa req-477ad0d4-a6eb-421d-89ad-b126d1aa1ea1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111228 Aug 17 19:45:44.757692 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 386/776] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:46:24.117596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:46:24.118438 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=60 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:46:24.122891 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d4495ab7-4b11-431e-8cc3-c101f6b06734 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:24.123389 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d4495ab7-4b11-431e-8cc3-c101f6b06734 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:24.131110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4495ab7-4b11-431e-8cc3-c101f6b06734 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:24.131727 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4495ab7-4b11-431e-8cc3-c101f6b06734 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:24.132423 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4495ab7-4b11-431e-8cc3-c101f6b06734 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:24.133119 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4495ab7-4b11-431e-8cc3-c101f6b06734 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:24.133741 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4495ab7-4b11-431e-8cc3-c101f6b06734 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:24.134174 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4495ab7-4b11-431e-8cc3-c101f6b06734 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:24.162165 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d4495ab7-4b11-431e-8cc3-c101f6b06734 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/ips" status: 200 len: 150 microversion: 2.1 time: 0.046283 Aug 17 19:46:24.162731 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 391/777] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 17 19:46:24 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:46:25.519990 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:46:25.520740 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:46:25.525193 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-077b2bbd-a695-4946-9e58-7f57f4dc253e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af803c4c-9b4d-460a-9057-0a568ff1b0b3"}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:46:25.527617 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-077b2bbd-a695-4946-9e58-7f57f4dc253e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:25.535080 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-077b2bbd-a695-4946-9e58-7f57f4dc253e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:25.535777 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-077b2bbd-a695-4946-9e58-7f57f4dc253e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:25.536221 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-077b2bbd-a695-4946-9e58-7f57f4dc253e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:25.536922 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-077b2bbd-a695-4946-9e58-7f57f4dc253e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:25.537418 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-077b2bbd-a695-4946-9e58-7f57f4dc253e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:25.537847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-077b2bbd-a695-4946-9e58-7f57f4dc253e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:25.782186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-077b2bbd-a695-4946-9e58-7f57f4dc253e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262964 Aug 17 19:46:25.783162 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 387/778] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:46:25 2022] POST /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:46:32.259901 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-be5d40dd-a278-400b-b311-10e5030d3088 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: .version_select at 0x7f3689e6d8b0>, body: {"keypair": {"name": "tempest-keypair-553783450", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxYNn9If8ICjiASvMOoYVVXig4JWjTRfxjZmASFdedEYhhzY5Rt09AxHN5ZTO6kH0FqUuHQ5r6kvyDaXUPOCyGDpBxs3rBeyvomPRVp3x8HMvG4P1QdOOywTpVFhbPV9Q=="}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:46:32.275893 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-be5d40dd-a278-400b-b311-10e5030d3088 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for project d48524fb6ff040dcac98b23363268772. Resources: {'key_pairs'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:46:32.279629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-be5d40dd-a278-400b-b311-10e5030d3088 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for user 22406c8108a4408aa39c5d174d032e20 and project d48524fb6ff040dcac98b23363268772. Resources: {'key_pairs'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:46:32.300678 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-be5d40dd-a278-400b-b311-10e5030d3088 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044686 Aug 17 19:46:32.301287 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 392/779] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 17 19:46:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:46:33.688604 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1069932362", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04936ff2-1cb2-462b-9dfb-59deb589561c"}], "security_groups": [{"name": "tempest-securitygroup--828022431"}], "key_name": "tempest-keypair-553783450", "user_data": "}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:46:33.796747 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.network.neutron [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] validate_networks() for [('04936ff2-1cb2-462b-9dfb-59deb589561c', None, None, None, None, None)] {{(pid=132530) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:46:34.196149 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Flavor limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:46:34.196712 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Image limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:46:34.197255 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Flavor pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:46:34.198015 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Image pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:46:34.198456 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:46:34.208327 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:34.208808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:34.209303 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:34.209990 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:34.210443 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:34.210864 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:34.227899 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for project d48524fb6ff040dcac98b23363268772. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:46:34.231819 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for user 22406c8108a4408aa39c5d174d032e20 and project d48524fb6ff040dcac98b23363268772. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:46:34.243169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Going to run 1 instances... {{(pid=132530) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:46:34.245565 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132530) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:46:34.291041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-9457d4de-4965-4a14-8e4c-2c45a6437d83 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.607453 Aug 17 19:46:34.291700 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 388/780] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:46:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:46:34.302585 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-be1a827d-0520-4652-aee5-2a216c37c8ce tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:34.303428 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-be1a827d-0520-4652-aee5-2a216c37c8ce tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:34.305749 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=4 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:46:34.389760 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-be1a827d-0520-4652-aee5-2a216c37c8ce tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:34.397947 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-be1a827d-0520-4652-aee5-2a216c37c8ce tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1241 microversion: 2.1 time: 0.099219 Aug 17 19:46:34.398956 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 393/781] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:34 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:35.418726 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3b67c197-d41d-4420-9758-76cd9e4558e8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:35.419216 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3b67c197-d41d-4420-9758-76cd9e4558e8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:35.427548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3b67c197-d41d-4420-9758-76cd9e4558e8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:35.428027 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3b67c197-d41d-4420-9758-76cd9e4558e8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:35.428448 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3b67c197-d41d-4420-9758-76cd9e4558e8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:35.429135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3b67c197-d41d-4420-9758-76cd9e4558e8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:35.429631 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3b67c197-d41d-4420-9758-76cd9e4558e8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:35.430052 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3b67c197-d41d-4420-9758-76cd9e4558e8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:35.497608 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3b67c197-d41d-4420-9758-76cd9e4558e8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:35.505601 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3b67c197-d41d-4420-9758-76cd9e4558e8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1299 microversion: 2.1 time: 0.090634 Aug 17 19:46:35.506160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 389/782] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:35 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:36.542880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-86d0d12d-3029-428c-acfb-7b95581163fe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:36.545244 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-86d0d12d-3029-428c-acfb-7b95581163fe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:36.556054 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86d0d12d-3029-428c-acfb-7b95581163fe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:36.568272 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86d0d12d-3029-428c-acfb-7b95581163fe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:36.568725 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86d0d12d-3029-428c-acfb-7b95581163fe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:36.569505 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86d0d12d-3029-428c-acfb-7b95581163fe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:36.569963 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86d0d12d-3029-428c-acfb-7b95581163fe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:36.570385 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86d0d12d-3029-428c-acfb-7b95581163fe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:36.716509 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-86d0d12d-3029-428c-acfb-7b95581163fe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:36.725528 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-86d0d12d-3029-428c-acfb-7b95581163fe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1366 microversion: 2.1 time: 0.201294 Aug 17 19:46:36.726202 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 394/783] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:36 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:46:36.921526 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-3d0b04a7-7ee8-485d-816c-109cdd000a18 req-0e9b18eb-0239-414b-b771-4fd35895c637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "368e12e0-cb5a-4ad5-a293-ab7086cf4e95", "tag": "b0e8138e-8b47-4271-8536-51cd896bbfda"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:46:36.931192 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-3d0b04a7-7ee8-485d-816c-109cdd000a18 req-0e9b18eb-0239-414b-b771-4fd35895c637 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:36.931898 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-3d0b04a7-7ee8-485d-816c-109cdd000a18 req-0e9b18eb-0239-414b-b771-4fd35895c637 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:36.932680 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-3d0b04a7-7ee8-485d-816c-109cdd000a18 req-0e9b18eb-0239-414b-b771-4fd35895c637 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:36.958934 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-3d0b04a7-7ee8-485d-816c-109cdd000a18 req-0e9b18eb-0239-414b-b771-4fd35895c637 service nova] Creating event network-changed:b0e8138e-8b47-4271-8536-51cd896bbfda for instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 on hv-cinder-85069 Aug 17 19:46:36.964004 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-3d0b04a7-7ee8-485d-816c-109cdd000a18 req-0e9b18eb-0239-414b-b771-4fd35895c637 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048266 Aug 17 19:46:36.964525 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 390/784] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:46:37.746910 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6ba991d4-5421-42f2-bb21-e44682992294 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:37.747531 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-6ba991d4-5421-42f2-bb21-e44682992294 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:37.753958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ba991d4-5421-42f2-bb21-e44682992294 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:37.754419 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ba991d4-5421-42f2-bb21-e44682992294 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:37.754854 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ba991d4-5421-42f2-bb21-e44682992294 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:37.755543 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ba991d4-5421-42f2-bb21-e44682992294 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:37.755992 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ba991d4-5421-42f2-bb21-e44682992294 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:37.756415 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-6ba991d4-5421-42f2-bb21-e44682992294 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:37.888683 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-6ba991d4-5421-42f2-bb21-e44682992294 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:37.897030 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6ba991d4-5421-42f2-bb21-e44682992294 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1366 microversion: 2.1 time: 0.153867 Aug 17 19:46:37.897648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 395/785] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:37 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:38.919686 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f66a38bc-5566-45aa-8cf4-158d78147c41 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:38.920447 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f66a38bc-5566-45aa-8cf4-158d78147c41 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:38.928130 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f66a38bc-5566-45aa-8cf4-158d78147c41 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:38.928605 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f66a38bc-5566-45aa-8cf4-158d78147c41 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:38.929030 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f66a38bc-5566-45aa-8cf4-158d78147c41 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:38.929740 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f66a38bc-5566-45aa-8cf4-158d78147c41 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:38.930186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f66a38bc-5566-45aa-8cf4-158d78147c41 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:38.930601 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f66a38bc-5566-45aa-8cf4-158d78147c41 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:39.062598 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f66a38bc-5566-45aa-8cf4-158d78147c41 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:39.070189 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f66a38bc-5566-45aa-8cf4-158d78147c41 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1366 microversion: 2.1 time: 0.155268 Aug 17 19:46:39.070778 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 391/786] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:38 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:40.090908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ef188aff-20b2-40ff-879a-88abc6f628ae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:40.091512 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ef188aff-20b2-40ff-879a-88abc6f628ae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:40.098042 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ef188aff-20b2-40ff-879a-88abc6f628ae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:40.098513 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ef188aff-20b2-40ff-879a-88abc6f628ae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:40.098941 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ef188aff-20b2-40ff-879a-88abc6f628ae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:40.099616 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ef188aff-20b2-40ff-879a-88abc6f628ae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:40.100060 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ef188aff-20b2-40ff-879a-88abc6f628ae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:40.100473 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ef188aff-20b2-40ff-879a-88abc6f628ae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:40.232649 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-ef188aff-20b2-40ff-879a-88abc6f628ae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:40.240880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ef188aff-20b2-40ff-879a-88abc6f628ae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1366 microversion: 2.1 time: 0.153873 Aug 17 19:46:40.241486 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 396/787] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:40 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:41.262462 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4b2a00da-cd60-417e-8133-d0ae8a29da35 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:41.263035 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4b2a00da-cd60-417e-8133-d0ae8a29da35 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:41.270031 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4b2a00da-cd60-417e-8133-d0ae8a29da35 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:41.270515 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4b2a00da-cd60-417e-8133-d0ae8a29da35 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:41.270960 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4b2a00da-cd60-417e-8133-d0ae8a29da35 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:41.271650 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4b2a00da-cd60-417e-8133-d0ae8a29da35 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:41.272104 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4b2a00da-cd60-417e-8133-d0ae8a29da35 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:41.272533 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4b2a00da-cd60-417e-8133-d0ae8a29da35 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:41.406630 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-4b2a00da-cd60-417e-8133-d0ae8a29da35 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:41.414314 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4b2a00da-cd60-417e-8133-d0ae8a29da35 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1366 microversion: 2.1 time: 0.155753 Aug 17 19:46:41.414890 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 392/788] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:41 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:41.868295 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-3abba356-2dee-42f1-9f33-be798ea9a1b4 req-2a57dea7-74f5-4675-9806-ff5318c776c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "368e12e0-cb5a-4ad5-a293-ab7086cf4e95", "name": "network-vif-plugged", "status": "completed", "tag": "b0e8138e-8b47-4271-8536-51cd896bbfda"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:46:41.879128 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-3abba356-2dee-42f1-9f33-be798ea9a1b4 req-2a57dea7-74f5-4675-9806-ff5318c776c1 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:41.879583 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-3abba356-2dee-42f1-9f33-be798ea9a1b4 req-2a57dea7-74f5-4675-9806-ff5318c776c1 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:41.880016 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-3abba356-2dee-42f1-9f33-be798ea9a1b4 req-2a57dea7-74f5-4675-9806-ff5318c776c1 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:41.892357 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-3abba356-2dee-42f1-9f33-be798ea9a1b4 req-2a57dea7-74f5-4675-9806-ff5318c776c1 service nova] Creating event network-vif-plugged:b0e8138e-8b47-4271-8536-51cd896bbfda for instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 on hv-cinder-85069 Aug 17 19:46:41.897486 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-3abba356-2dee-42f1-9f33-be798ea9a1b4 req-2a57dea7-74f5-4675-9806-ff5318c776c1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032811 Aug 17 19:46:41.898072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 397/789] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:46:42.434701 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-bf233492-965c-42b8-84c4-9d24fec88bcc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:42.435315 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-bf233492-965c-42b8-84c4-9d24fec88bcc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:42.442416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bf233492-965c-42b8-84c4-9d24fec88bcc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:42.442896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bf233492-965c-42b8-84c4-9d24fec88bcc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:42.443332 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bf233492-965c-42b8-84c4-9d24fec88bcc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:42.444017 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bf233492-965c-42b8-84c4-9d24fec88bcc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:42.444467 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bf233492-965c-42b8-84c4-9d24fec88bcc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:42.444886 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bf233492-965c-42b8-84c4-9d24fec88bcc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:42.573946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-bf233492-965c-42b8-84c4-9d24fec88bcc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:42.581287 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-bf233492-965c-42b8-84c4-9d24fec88bcc tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1366 microversion: 2.1 time: 0.150402 Aug 17 19:46:42.581881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 393/790] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:42 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:43.603615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-01790301-7324-4070-9c7b-e43091a1975a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:43.604346 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-01790301-7324-4070-9c7b-e43091a1975a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:43.610467 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-01790301-7324-4070-9c7b-e43091a1975a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:43.610948 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-01790301-7324-4070-9c7b-e43091a1975a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:43.612097 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-01790301-7324-4070-9c7b-e43091a1975a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:43.612898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-01790301-7324-4070-9c7b-e43091a1975a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:43.613465 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-01790301-7324-4070-9c7b-e43091a1975a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:43.613898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-01790301-7324-4070-9c7b-e43091a1975a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:43.758715 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-01790301-7324-4070-9c7b-e43091a1975a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:43.766101 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-01790301-7324-4070-9c7b-e43091a1975a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1366 microversion: 2.1 time: 0.167351 Aug 17 19:46:43.766658 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 398/791] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:43 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:44.787838 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-59a690e2-e812-4fd5-9adb-d6f9611062ab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:44.788446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-59a690e2-e812-4fd5-9adb-d6f9611062ab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:44.794416 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:46:44.795315 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=6 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:46:44.799225 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-59a690e2-e812-4fd5-9adb-d6f9611062ab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:44.799726 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-59a690e2-e812-4fd5-9adb-d6f9611062ab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:44.800191 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-59a690e2-e812-4fd5-9adb-d6f9611062ab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:44.800882 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-59a690e2-e812-4fd5-9adb-d6f9611062ab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:44.801361 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-59a690e2-e812-4fd5-9adb-d6f9611062ab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:44.801784 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-59a690e2-e812-4fd5-9adb-d6f9611062ab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:44.996214 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-59a690e2-e812-4fd5-9adb-d6f9611062ab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:45.004281 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-59a690e2-e812-4fd5-9adb-d6f9611062ab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1556 microversion: 2.1 time: 0.220332 Aug 17 19:46:45.004860 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 394/792] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:44 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1556 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:45.025596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a01c9549-26a7-4c3a-8447-d752b26bce2c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:45.026164 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a01c9549-26a7-4c3a-8447-d752b26bce2c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:45.028151 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=6 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:46:45.034471 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a01c9549-26a7-4c3a-8447-d752b26bce2c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:45.034970 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a01c9549-26a7-4c3a-8447-d752b26bce2c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:45.035406 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a01c9549-26a7-4c3a-8447-d752b26bce2c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:45.036107 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a01c9549-26a7-4c3a-8447-d752b26bce2c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:45.036568 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a01c9549-26a7-4c3a-8447-d752b26bce2c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:45.036999 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a01c9549-26a7-4c3a-8447-d752b26bce2c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:45.130518 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a01c9549-26a7-4c3a-8447-d752b26bce2c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108773 Aug 17 19:46:45.131186 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 399/793] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 17 19:46:45 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:46:45.291550 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8e53218c-15c6-4ed7-85a6-01669309d119 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:45.293723 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-8e53218c-15c6-4ed7-85a6-01669309d119 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:45.295422 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-c683a8a3-e5c4-4047-95cb-006c1b2e0e1a req-fa102f86-b58e-4849-88ee-78e4bae629a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76985445-294d-45f5-9f95-40951eed1555", "tag": "380031c9-b01e-4d04-9d20-1e65825341f8"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:46:45.301353 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e53218c-15c6-4ed7-85a6-01669309d119 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:45.302237 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e53218c-15c6-4ed7-85a6-01669309d119 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:45.302935 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e53218c-15c6-4ed7-85a6-01669309d119 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:45.303855 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e53218c-15c6-4ed7-85a6-01669309d119 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:45.304691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e53218c-15c6-4ed7-85a6-01669309d119 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:45.305363 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8e53218c-15c6-4ed7-85a6-01669309d119 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:45.321122 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-c683a8a3-e5c4-4047-95cb-006c1b2e0e1a req-fa102f86-b58e-4849-88ee-78e4bae629a8 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:45.321837 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-c683a8a3-e5c4-4047-95cb-006c1b2e0e1a req-fa102f86-b58e-4849-88ee-78e4bae629a8 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:45.322508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-c683a8a3-e5c4-4047-95cb-006c1b2e0e1a req-fa102f86-b58e-4849-88ee-78e4bae629a8 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:45.334733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-8e53218c-15c6-4ed7-85a6-01669309d119 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Going to try to terminate instance {{(pid=132530) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:46:45.345985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-c683a8a3-e5c4-4047-95cb-006c1b2e0e1a req-fa102f86-b58e-4849-88ee-78e4bae629a8 service nova] Creating event network-changed:380031c9-b01e-4d04-9d20-1e65825341f8 for instance 76985445-294d-45f5-9f95-40951eed1555 on hv-cinder-85069 Aug 17 19:46:45.351137 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-c683a8a3-e5c4-4047-95cb-006c1b2e0e1a req-fa102f86-b58e-4849-88ee-78e4bae629a8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060719 Aug 17 19:46:45.352311 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 400/794] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:46:45.430628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8e53218c-15c6-4ed7-85a6-01669309d119 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "DELETE /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 204 len: 0 microversion: 2.1 time: 0.142679 Aug 17 19:46:45.431611 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 395/795] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:46:45 2022] DELETE /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:46:45.440551 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5662e49c-9f9c-4926-a78d-d1d67b0b2459 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:45.441294 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5662e49c-9f9c-4926-a78d-d1d67b0b2459 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:45.451516 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5662e49c-9f9c-4926-a78d-d1d67b0b2459 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:45.452015 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5662e49c-9f9c-4926-a78d-d1d67b0b2459 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:45.453013 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5662e49c-9f9c-4926-a78d-d1d67b0b2459 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:45.453940 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5662e49c-9f9c-4926-a78d-d1d67b0b2459 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:45.454395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5662e49c-9f9c-4926-a78d-d1d67b0b2459 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:45.454994 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5662e49c-9f9c-4926-a78d-d1d67b0b2459 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:45.621596 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5662e49c-9f9c-4926-a78d-d1d67b0b2459 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:45.631555 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5662e49c-9f9c-4926-a78d-d1d67b0b2459 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.195353 Aug 17 19:46:45.632879 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 401/796] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:45 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:46.186384 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-1beaba83-c207-442d-bc19-8326ff402a7f req-3cb42717-ff08-40a9-b641-0c9c755a602b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "368e12e0-cb5a-4ad5-a293-ab7086cf4e95", "tag": "b0e8138e-8b47-4271-8536-51cd896bbfda"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:46:46.200138 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-1beaba83-c207-442d-bc19-8326ff402a7f req-3cb42717-ff08-40a9-b641-0c9c755a602b service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:46.200862 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-1beaba83-c207-442d-bc19-8326ff402a7f req-3cb42717-ff08-40a9-b641-0c9c755a602b service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:46.201346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-1beaba83-c207-442d-bc19-8326ff402a7f req-3cb42717-ff08-40a9-b641-0c9c755a602b service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:46.217076 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-1beaba83-c207-442d-bc19-8326ff402a7f req-3cb42717-ff08-40a9-b641-0c9c755a602b service nova] Creating event network-changed:b0e8138e-8b47-4271-8536-51cd896bbfda for instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 on hv-cinder-85069 Aug 17 19:46:46.222266 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-1beaba83-c207-442d-bc19-8326ff402a7f req-3cb42717-ff08-40a9-b641-0c9c755a602b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041366 Aug 17 19:46:46.223325 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 396/797] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:46:46.655467 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-15f404d3-28ba-4662-b4e8-9b1a875e7728 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:46.656611 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-15f404d3-28ba-4662-b4e8-9b1a875e7728 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:46.662954 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-15f404d3-28ba-4662-b4e8-9b1a875e7728 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:46.663570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-15f404d3-28ba-4662-b4e8-9b1a875e7728 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:46.664425 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-15f404d3-28ba-4662-b4e8-9b1a875e7728 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:46.665234 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-15f404d3-28ba-4662-b4e8-9b1a875e7728 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:46.665764 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-15f404d3-28ba-4662-b4e8-9b1a875e7728 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:46.666292 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-15f404d3-28ba-4662-b4e8-9b1a875e7728 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:46.812369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-15f404d3-28ba-4662-b4e8-9b1a875e7728 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:46.820040 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-15f404d3-28ba-4662-b4e8-9b1a875e7728 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.169302 Aug 17 19:46:46.820629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 402/798] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:46 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:47.842550 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-02abd976-6d7e-4143-a62c-323ffce03432 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:47.843839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-02abd976-6d7e-4143-a62c-323ffce03432 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:47.850496 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-02abd976-6d7e-4143-a62c-323ffce03432 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:47.850980 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-02abd976-6d7e-4143-a62c-323ffce03432 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:47.851421 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-02abd976-6d7e-4143-a62c-323ffce03432 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:47.852125 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-02abd976-6d7e-4143-a62c-323ffce03432 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:47.852583 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-02abd976-6d7e-4143-a62c-323ffce03432 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:47.853007 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-02abd976-6d7e-4143-a62c-323ffce03432 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:47.989710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-02abd976-6d7e-4143-a62c-323ffce03432 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:47.997421 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-02abd976-6d7e-4143-a62c-323ffce03432 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1568 microversion: 2.1 time: 0.159054 Aug 17 19:46:47.998073 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 397/799] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:47 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:48.317697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-dee1af8c-71f3-472c-843f-c2a13d003584 req-6cf3cf46-ec06-40fe-9eae-942b4ef64c96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76985445-294d-45f5-9f95-40951eed1555", "name": "network-vif-deleted", "tag": "380031c9-b01e-4d04-9d20-1e65825341f8"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:46:48.327940 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-dee1af8c-71f3-472c-843f-c2a13d003584 req-6cf3cf46-ec06-40fe-9eae-942b4ef64c96 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:48.328417 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-dee1af8c-71f3-472c-843f-c2a13d003584 req-6cf3cf46-ec06-40fe-9eae-942b4ef64c96 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:48.328835 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-dee1af8c-71f3-472c-843f-c2a13d003584 req-6cf3cf46-ec06-40fe-9eae-942b4ef64c96 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:48.340114 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-dee1af8c-71f3-472c-843f-c2a13d003584 req-6cf3cf46-ec06-40fe-9eae-942b4ef64c96 service nova] Creating event network-vif-deleted:380031c9-b01e-4d04-9d20-1e65825341f8 for instance 76985445-294d-45f5-9f95-40951eed1555 on hv-cinder-85069 Aug 17 19:46:48.345100 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-dee1af8c-71f3-472c-843f-c2a13d003584 req-6cf3cf46-ec06-40fe-9eae-942b4ef64c96 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031141 Aug 17 19:46:48.345773 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 403/800] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:46:49.019162 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:49.019775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:49.026379 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:49.026856 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:49.027294 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:49.028007 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:49.028457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:49.028891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:49.060998 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:49.061515 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:49.061948 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:49.062393 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lazy-loading 'fault' on Instance uuid 76985445-294d-45f5-9f95-40951eed1555 {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:46:49.105446 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3190c231aeb24ed6836d8fb61af24fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e072daa36df4ab7b836616c2b138c01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:46:49.114384 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-fcec0b16-f2fa-4e6f-a234-e7e4bfbbf27d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 200 len: 1224 microversion: 2.1 time: 0.099365 Aug 17 19:46:49.115253 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 398/801] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:49 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:46:50.136253 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1ab6a369-89d8-43d3-a63b-772539ea0e1d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:50.136950 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1ab6a369-89d8-43d3-a63b-772539ea0e1d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] [instance: 76985445-294d-45f5-9f95-40951eed1555] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:46:50.143090 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1ab6a369-89d8-43d3-a63b-772539ea0e1d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:50.143564 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1ab6a369-89d8-43d3-a63b-772539ea0e1d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:50.143997 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1ab6a369-89d8-43d3-a63b-772539ea0e1d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:50.144674 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1ab6a369-89d8-43d3-a63b-772539ea0e1d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:46:50.145126 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1ab6a369-89d8-43d3-a63b-772539ea0e1d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:46:50.145574 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1ab6a369-89d8-43d3-a63b-772539ea0e1d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:46:50.161002 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-1ab6a369-89d8-43d3-a63b-772539ea0e1d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] HTTP exception thrown: Instance 76985445-294d-45f5-9f95-40951eed1555 could not be found. Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1ab6a369-89d8-43d3-a63b-772539ea0e1d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Request method failure captured: Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 HTTP/1.1 Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_USIu841Q3wqdpe3nqmaZKQWlfLbeanqjC5O7KXY4zkEon36jdCm3EUkl9ExQ3UwrrQJX3TB6EgPIyXV9bYL02OUVg0sIt4Bt6qPqmteoyJ5vbxwY78lGEOj4A-DYSZW6kGIIkMDV_cRj2AIltlkqUqGVwPPfvhsprYVi0PkfKzQHnU Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: 7e072daa36df4ab7b836616c2b138c01 Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-TestShelveInstance-1912255926 Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:46:50.162640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:46:50.164380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/7e072daa36df4ab7b836616c2b138c01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7e072daa36df4ab7b836616c2b138c01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_7e072daa36df4ab7b836616c2b138c01", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/7e072daa36df4ab7b836616c2b138c01"}]}] Aug 17 19:46:50.164380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-TestShelveInstance-1912255926 Aug 17 19:46:50.164380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: 7e072daa36df4ab7b836616c2b138c01 Aug 17 19:46:50.164380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-TestShelveInstance-1912255926 Aug 17 19:46:50.164380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-TestShelveInstance-1912255926-project Aug 17 19:46:50.164380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:46:50.164380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:46:50.164380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 3190c231aeb24ed6836d8fb61af24fc8 Aug 17 19:46:50.164380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-TestShelveInstance-1912255926-project Aug 17 19:46:50.164380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:46:50.164380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 76985445-294d-45f5-9f95-40951eed1555 could not be found. Aug 17 19:46:50.164380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '76985445-294d-45f5-9f95-40951eed1555'} Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76985445-294d-45f5-9f95-40951eed1555 could not be found. Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:46:50.165395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76985445-294d-45f5-9f95-40951eed1555 could not be found. Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76985445-294d-45f5-9f95-40951eed1555 could not be found. Aug 17 19:46:50.167029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:46:50.168448 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1ab6a369-89d8-43d3-a63b-772539ea0e1d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Returning 404 to user: Instance 76985445-294d-45f5-9f95-40951eed1555 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:46:50.168448 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1ab6a369-89d8-43d3-a63b-772539ea0e1d tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555" status: 404 len: 111 microversion: 2.1 time: 0.032493 Aug 17 19:46:50.168448 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 404/802] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:46:50 2022] GET /compute/v2.1/servers/76985445-294d-45f5-9f95-40951eed1555 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:46:50.329126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-78e6343c-375f-4e50-9b55-18b1c8019776 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] Calling method '.version_select at 0x7f3689efe9d0>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:46:50.350500 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-78e6343c-375f-4e50-9b55-18b1c8019776 tempest-TestShelveInstance-1912255926 tempest-TestShelveInstance-1912255926-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1698037777" status: 202 len: 0 microversion: 2.1 time: 0.025043 Aug 17 19:46:50.351600 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 399/803] 10.222.0.59 () {58 vars in 1254 bytes} [Wed Aug 17 19:46:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1698037777 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:47:17.797904 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-204880263", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "networks": [{"uuid": "d10cb1f4-6eb1-45b3-ae3e-3bd1476e3af7"}]}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:47:17.806439 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:47:17.807075 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=48 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:47:17.852957 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.network.neutron [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] validate_networks() for [('d10cb1f4-6eb1-45b3-ae3e-3bd1476e3af7', None, None, None, None, None)] {{(pid=132531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:47:18.246011 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Flavor limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:47:18.246439 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Image limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:47:18.246916 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Flavor pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:47:18.247354 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Image pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:47:18.247767 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:47:18.256824 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:18.257348 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:18.257787 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:18.258514 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:18.259124 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:18.259562 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:18.276751 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Getting quotas for project e1bc20a6ee5c4e61ab2f8b0683543ddc. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:47:18.280707 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Getting quotas for user 285afd956888457d9cd947713e6826ac and project e1bc20a6ee5c4e61ab2f8b0683543ddc. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:47:18.292256 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Going to run 1 instances... {{(pid=132531) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:47:18.294521 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:47:18.341931 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d46dfdd1-4754-4beb-8be5-9463ae9d2b1c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.548494 Aug 17 19:47:18.342582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 405/804] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:47:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:47:18.353965 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d1d1cce3-2942-4eb3-9ec9-f2edb0f5028e tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:18.354777 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d1d1cce3-2942-4eb3-9ec9-f2edb0f5028e tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:18.357476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:47:18.358308 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:47:18.421200 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d1d1cce3-2942-4eb3-9ec9-f2edb0f5028e tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:18.429026 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d1d1cce3-2942-4eb3-9ec9-f2edb0f5028e tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1218 microversion: 2.1 time: 0.078979 Aug 17 19:47:18.429713 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 400/805] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:18 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:19.450216 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-2bbf40cb-68e8-415b-bf82-0075f909a5e9 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:19.450940 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-2bbf40cb-68e8-415b-bf82-0075f909a5e9 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:19.457477 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2bbf40cb-68e8-415b-bf82-0075f909a5e9 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:19.457973 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2bbf40cb-68e8-415b-bf82-0075f909a5e9 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:19.458399 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2bbf40cb-68e8-415b-bf82-0075f909a5e9 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:19.459087 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2bbf40cb-68e8-415b-bf82-0075f909a5e9 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:19.459538 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2bbf40cb-68e8-415b-bf82-0075f909a5e9 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:19.459960 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-2bbf40cb-68e8-415b-bf82-0075f909a5e9 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:19.523716 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2bbf40cb-68e8-415b-bf82-0075f909a5e9 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:19.531188 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-2bbf40cb-68e8-415b-bf82-0075f909a5e9 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1276 microversion: 2.1 time: 0.085082 Aug 17 19:47:19.531747 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 406/806] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:19 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1276 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:20.465381 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-7a4bf5ce-1aab-4fb0-b1b0-32386cb64076 req-91b765b9-20f6-4eb1-9e38-4c71b673f4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba797bea-019f-4129-a489-762f4bf2efae", "tag": "b650093c-1999-4638-9b53-a040d3edce26"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:47:20.476641 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-7a4bf5ce-1aab-4fb0-b1b0-32386cb64076 req-91b765b9-20f6-4eb1-9e38-4c71b673f4f0 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:20.477042 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-7a4bf5ce-1aab-4fb0-b1b0-32386cb64076 req-91b765b9-20f6-4eb1-9e38-4c71b673f4f0 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:20.477497 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-7a4bf5ce-1aab-4fb0-b1b0-32386cb64076 req-91b765b9-20f6-4eb1-9e38-4c71b673f4f0 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:20.488254 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-7a4bf5ce-1aab-4fb0-b1b0-32386cb64076 req-91b765b9-20f6-4eb1-9e38-4c71b673f4f0 service nova] Creating event network-changed:b650093c-1999-4638-9b53-a040d3edce26 for instance ba797bea-019f-4129-a489-762f4bf2efae on hv-cinder-85069 Aug 17 19:47:20.493276 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-7a4bf5ce-1aab-4fb0-b1b0-32386cb64076 req-91b765b9-20f6-4eb1-9e38-4c71b673f4f0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031560 Aug 17 19:47:20.494060 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 401/807] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:47:20.552637 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-faaf51b2-f533-403b-ab69-324eb0ff2ad6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:20.553325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-faaf51b2-f533-403b-ab69-324eb0ff2ad6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:20.559640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-faaf51b2-f533-403b-ab69-324eb0ff2ad6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:20.560124 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-faaf51b2-f533-403b-ab69-324eb0ff2ad6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:20.560598 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-faaf51b2-f533-403b-ab69-324eb0ff2ad6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:20.561310 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-faaf51b2-f533-403b-ab69-324eb0ff2ad6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:20.561796 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-faaf51b2-f533-403b-ab69-324eb0ff2ad6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:20.562229 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-faaf51b2-f533-403b-ab69-324eb0ff2ad6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:20.692960 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-faaf51b2-f533-403b-ab69-324eb0ff2ad6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:20.700882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-faaf51b2-f533-403b-ab69-324eb0ff2ad6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1318 microversion: 2.1 time: 0.152158 Aug 17 19:47:20.701475 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 407/808] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:20 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:21.722458 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8a1d4c22-1c0a-469f-ae2a-60cc07aa4ab6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:21.723153 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-8a1d4c22-1c0a-469f-ae2a-60cc07aa4ab6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:21.729887 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8a1d4c22-1c0a-469f-ae2a-60cc07aa4ab6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:21.730383 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8a1d4c22-1c0a-469f-ae2a-60cc07aa4ab6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:21.730822 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8a1d4c22-1c0a-469f-ae2a-60cc07aa4ab6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:21.731527 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8a1d4c22-1c0a-469f-ae2a-60cc07aa4ab6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:21.731985 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8a1d4c22-1c0a-469f-ae2a-60cc07aa4ab6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:21.732413 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8a1d4c22-1c0a-469f-ae2a-60cc07aa4ab6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:21.863676 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8a1d4c22-1c0a-469f-ae2a-60cc07aa4ab6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:21.871279 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8a1d4c22-1c0a-469f-ae2a-60cc07aa4ab6 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1318 microversion: 2.1 time: 0.152948 Aug 17 19:47:21.871895 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 402/809] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:21 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:22.232772 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-eee1c3e8-d42a-4571-9a4a-925b63762b69 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:22.233333 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-eee1c3e8-d42a-4571-9a4a-925b63762b69 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:22.240099 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-eee1c3e8-d42a-4571-9a4a-925b63762b69 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:22.240585 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-eee1c3e8-d42a-4571-9a4a-925b63762b69 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:22.241023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-eee1c3e8-d42a-4571-9a4a-925b63762b69 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:22.241752 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-eee1c3e8-d42a-4571-9a4a-925b63762b69 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:22.242208 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-eee1c3e8-d42a-4571-9a4a-925b63762b69 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:22.242634 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-eee1c3e8-d42a-4571-9a4a-925b63762b69 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:22.265178 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-eee1c3e8-d42a-4571-9a4a-925b63762b69 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95/ips" status: 200 len: 148 microversion: 2.1 time: 0.036376 Aug 17 19:47:22.265775 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 408/810] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 17 19:47:22 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:47:22.276777 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-69c4e39a-653c-467a-bc91-28a08bd0e321 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af803c4c-9b4d-460a-9057-0a568ff1b0b3"}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:47:22.279083 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-69c4e39a-653c-467a-bc91-28a08bd0e321 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:22.285448 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-69c4e39a-653c-467a-bc91-28a08bd0e321 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:22.285922 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-69c4e39a-653c-467a-bc91-28a08bd0e321 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:22.286351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-69c4e39a-653c-467a-bc91-28a08bd0e321 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:22.287028 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-69c4e39a-653c-467a-bc91-28a08bd0e321 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:22.287472 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-69c4e39a-653c-467a-bc91-28a08bd0e321 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:22.287885 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-69c4e39a-653c-467a-bc91-28a08bd0e321 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:22.364518 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-69c4e39a-653c-467a-bc91-28a08bd0e321 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Invalid volume: volume af803c4c-9b4d-460a-9057-0a568ff1b0b3 is already attached to instances: 78428449-8788-42ec-bdb0-1ee8723c3ea3 Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-69c4e39a-653c-467a-bc91-28a08bd0e321 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: POST /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95/os-volume_attachments HTTP/1.1 Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 74 Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:47:22.366499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:47:22.368170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:47:22.368170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:47:22.368170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:47:22.368170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:47:22.368170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:47:22.368170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:47:22.368170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:47:22.368170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:47:22.368170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:47:22.368170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Aug 17 19:47:22.368170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {"volumeAttachment": {"volumeId": "af803c4c-9b4d-460a-9057-0a568ff1b0b3"}} Aug 17 19:47:22.368170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Invalid volume: volume af803c4c-9b4d-460a-9057-0a568ff1b0b3 is already attached to instances: 78428449-8788-42ec-bdb0-1ee8723c3ea3 Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'server_id': '368e12e0-cb5a-4ad5-a293-ab7086cf4e95', 'body': {'volumeAttachment': {'volumeId': 'af803c4c-9b4d-460a-9057-0a568ff1b0b3'}}} Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume af803c4c-9b4d-460a-9057-0a568ff1b0b3 is already attached to instances: 78428449-8788-42ec-bdb0-1ee8723c3ea3 Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:47:22.369065 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume af803c4c-9b4d-460a-9057-0a568ff1b0b3 is already attached to instances: 78428449-8788-42ec-bdb0-1ee8723c3ea3 Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:47:22.370524 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:47:22.372574 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:47:22.372574 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:47:22.372574 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:47:22.372574 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume af803c4c-9b4d-460a-9057-0a568ff1b0b3 is already attached to instances: 78428449-8788-42ec-bdb0-1ee8723c3ea3 Aug 17 19:47:22.372574 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:47:22.372574 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-69c4e39a-653c-467a-bc91-28a08bd0e321 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 400 to user: Invalid volume: volume af803c4c-9b4d-460a-9057-0a568ff1b0b3 is already attached to instances: 78428449-8788-42ec-bdb0-1ee8723c3ea3 {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:47:22.372574 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-69c4e39a-653c-467a-bc91-28a08bd0e321 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095117 Aug 17 19:47:22.372574 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 403/811] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:47:22 2022] POST /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 19:47:22.377834 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a375d944-147c-4464-a2c8-5ea494a31196 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:22.378340 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a375d944-147c-4464-a2c8-5ea494a31196 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:22.384177 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a375d944-147c-4464-a2c8-5ea494a31196 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:22.384659 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a375d944-147c-4464-a2c8-5ea494a31196 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:22.385096 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a375d944-147c-4464-a2c8-5ea494a31196 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:22.385818 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a375d944-147c-4464-a2c8-5ea494a31196 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:22.386276 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a375d944-147c-4464-a2c8-5ea494a31196 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:22.386701 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a375d944-147c-4464-a2c8-5ea494a31196 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:22.410924 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a375d944-147c-4464-a2c8-5ea494a31196 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:47:22.484149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a375d944-147c-4464-a2c8-5ea494a31196 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 204 len: 0 microversion: 2.1 time: 0.110097 Aug 17 19:47:22.484563 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 409/812] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:47:22 2022] DELETE /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:47:22.492879 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f2449a31-9972-4602-b8d8-caf7c9beab1c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:22.493552 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f2449a31-9972-4602-b8d8-caf7c9beab1c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:22.500186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f2449a31-9972-4602-b8d8-caf7c9beab1c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:22.501187 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f2449a31-9972-4602-b8d8-caf7c9beab1c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:22.501656 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f2449a31-9972-4602-b8d8-caf7c9beab1c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:22.502350 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f2449a31-9972-4602-b8d8-caf7c9beab1c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:22.502810 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f2449a31-9972-4602-b8d8-caf7c9beab1c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:22.503237 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f2449a31-9972-4602-b8d8-caf7c9beab1c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:22.629292 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f2449a31-9972-4602-b8d8-caf7c9beab1c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:22.636799 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f2449a31-9972-4602-b8d8-caf7c9beab1c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1679 microversion: 2.1 time: 0.147775 Aug 17 19:47:22.637394 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 404/813] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:22 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:22.893863 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3e48a141-9b0c-4ad1-a8d9-f06dd2de4507 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:22.894565 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3e48a141-9b0c-4ad1-a8d9-f06dd2de4507 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:22.900402 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3e48a141-9b0c-4ad1-a8d9-f06dd2de4507 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:22.900878 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3e48a141-9b0c-4ad1-a8d9-f06dd2de4507 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:22.901345 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3e48a141-9b0c-4ad1-a8d9-f06dd2de4507 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:22.902026 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3e48a141-9b0c-4ad1-a8d9-f06dd2de4507 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:22.902477 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3e48a141-9b0c-4ad1-a8d9-f06dd2de4507 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:22.902898 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3e48a141-9b0c-4ad1-a8d9-f06dd2de4507 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:23.032259 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3e48a141-9b0c-4ad1-a8d9-f06dd2de4507 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:23.039834 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3e48a141-9b0c-4ad1-a8d9-f06dd2de4507 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1318 microversion: 2.1 time: 0.150701 Aug 17 19:47:23.040397 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 410/814] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:22 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:23.658644 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c0f1314d-14d2-4059-bbaf-c85b92dbde6d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:23.659259 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c0f1314d-14d2-4059-bbaf-c85b92dbde6d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:23.665680 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0f1314d-14d2-4059-bbaf-c85b92dbde6d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:23.666161 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0f1314d-14d2-4059-bbaf-c85b92dbde6d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:23.666595 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0f1314d-14d2-4059-bbaf-c85b92dbde6d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:23.667285 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0f1314d-14d2-4059-bbaf-c85b92dbde6d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:23.667739 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0f1314d-14d2-4059-bbaf-c85b92dbde6d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:23.668164 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c0f1314d-14d2-4059-bbaf-c85b92dbde6d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:23.798926 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c0f1314d-14d2-4059-bbaf-c85b92dbde6d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:23.806427 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c0f1314d-14d2-4059-bbaf-c85b92dbde6d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1679 microversion: 2.1 time: 0.151688 Aug 17 19:47:23.806990 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 405/815] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:23 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:24.060707 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c9cde024-d760-4e19-805d-fc31cf36741c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:24.061940 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-c9cde024-d760-4e19-805d-fc31cf36741c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:24.068004 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c9cde024-d760-4e19-805d-fc31cf36741c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:24.068491 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c9cde024-d760-4e19-805d-fc31cf36741c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:24.068928 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c9cde024-d760-4e19-805d-fc31cf36741c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:24.069669 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c9cde024-d760-4e19-805d-fc31cf36741c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:24.070134 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c9cde024-d760-4e19-805d-fc31cf36741c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:24.070566 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c9cde024-d760-4e19-805d-fc31cf36741c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:24.208667 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-c9cde024-d760-4e19-805d-fc31cf36741c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:24.220517 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-c9cde024-d760-4e19-805d-fc31cf36741c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1318 microversion: 2.1 time: 0.163194 Aug 17 19:47:24.222179 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 411/816] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:24 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:24.777622 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-d955fc2b-0f34-4f9e-898e-05298677ce62 req-34336fd3-cc85-448e-8a7a-cc2dc63f26a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "368e12e0-cb5a-4ad5-a293-ab7086cf4e95", "name": "network-vif-deleted", "tag": "b0e8138e-8b47-4271-8536-51cd896bbfda"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:47:24.788159 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-d955fc2b-0f34-4f9e-898e-05298677ce62 req-34336fd3-cc85-448e-8a7a-cc2dc63f26a7 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:24.788554 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-d955fc2b-0f34-4f9e-898e-05298677ce62 req-34336fd3-cc85-448e-8a7a-cc2dc63f26a7 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:24.789041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-d955fc2b-0f34-4f9e-898e-05298677ce62 req-34336fd3-cc85-448e-8a7a-cc2dc63f26a7 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:24.800860 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-d955fc2b-0f34-4f9e-898e-05298677ce62 req-34336fd3-cc85-448e-8a7a-cc2dc63f26a7 service nova] Creating event network-vif-deleted:b0e8138e-8b47-4271-8536-51cd896bbfda for instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 on hv-cinder-85069 Aug 17 19:47:24.806028 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-d955fc2b-0f34-4f9e-898e-05298677ce62 req-34336fd3-cc85-448e-8a7a-cc2dc63f26a7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031937 Aug 17 19:47:24.806840 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 406/817] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:47:24.829928 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-11f761f7-771d-41d1-ad15-9aea735cdbae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:24.831095 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-11f761f7-771d-41d1-ad15-9aea735cdbae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:24.837497 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-11f761f7-771d-41d1-ad15-9aea735cdbae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:24.837983 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-11f761f7-771d-41d1-ad15-9aea735cdbae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:24.838616 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-11f761f7-771d-41d1-ad15-9aea735cdbae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:24.839493 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-11f761f7-771d-41d1-ad15-9aea735cdbae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:24.840117 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-11f761f7-771d-41d1-ad15-9aea735cdbae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:24.840992 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-11f761f7-771d-41d1-ad15-9aea735cdbae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:25.080537 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-11f761f7-771d-41d1-ad15-9aea735cdbae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:25.088036 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-11f761f7-771d-41d1-ad15-9aea735cdbae tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 200 len: 1326 microversion: 2.1 time: 0.263733 Aug 17 19:47:25.088597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 412/818] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:24 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 1326 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:25.242643 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-6a219de5-ea9b-4003-8ad8-ca2ff709ef09 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:25.243815 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-6a219de5-ea9b-4003-8ad8-ca2ff709ef09 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:25.250480 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6a219de5-ea9b-4003-8ad8-ca2ff709ef09 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:25.252011 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6a219de5-ea9b-4003-8ad8-ca2ff709ef09 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:25.252521 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6a219de5-ea9b-4003-8ad8-ca2ff709ef09 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:25.254013 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6a219de5-ea9b-4003-8ad8-ca2ff709ef09 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:25.254885 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6a219de5-ea9b-4003-8ad8-ca2ff709ef09 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:25.255635 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-6a219de5-ea9b-4003-8ad8-ca2ff709ef09 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:25.406192 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-6a219de5-ea9b-4003-8ad8-ca2ff709ef09 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:25.414111 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-6a219de5-ea9b-4003-8ad8-ca2ff709ef09 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1318 microversion: 2.1 time: 0.175683 Aug 17 19:47:25.414678 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 407/819] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:25 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:47:26.107998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-88c3851c-27c8-42db-8083-f665f26dd44c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:26.108619 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-88c3851c-27c8-42db-8083-f665f26dd44c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:26.115317 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-88c3851c-27c8-42db-8083-f665f26dd44c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:26.115807 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-88c3851c-27c8-42db-8083-f665f26dd44c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:26.116247 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-88c3851c-27c8-42db-8083-f665f26dd44c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:26.116954 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-88c3851c-27c8-42db-8083-f665f26dd44c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:26.117433 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-88c3851c-27c8-42db-8083-f665f26dd44c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:26.117855 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-88c3851c-27c8-42db-8083-f665f26dd44c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:26.132617 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-88c3851c-27c8-42db-8083-f665f26dd44c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-88c3851c-27c8-42db-8083-f665f26dd44c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 HTTP/1.1 Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:47:26.134296 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:47:26.135759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:47:26.135759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:47:26.135759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:47:26.135759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:47:26.135759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:47:26.135759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:47:26.135759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:47:26.135759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:47:26.135759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:47:26.135759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:47:26.135759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:47:26.135759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '368e12e0-cb5a-4ad5-a293-ab7086cf4e95'} Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:47:26.136600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:47:26.138368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:47:26.139934 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-88c3851c-27c8-42db-8083-f665f26dd44c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 404 to user: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:47:26.139934 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-88c3851c-27c8-42db-8083-f665f26dd44c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 404 len: 111 microversion: 2.1 time: 0.031639 Aug 17 19:47:26.139934 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 413/820] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:26 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:47:26.145703 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8fa87dd0-f40a-4b83-8b03-42bbbf0fd104 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '.version_select at 0x7f3689f8b4c0>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:26.168410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8fa87dd0-f40a-4b83-8b03-42bbbf0fd104 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-553783450" status: 202 len: 0 microversion: 2.1 time: 0.027149 Aug 17 19:47:26.173117 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 408/821] 10.222.0.59 () {58 vars in 1218 bytes} [Wed Aug 17 19:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-553783450 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:47:26.333551 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-6319fdf5-6ffa-40b3-9189-e6dbfcba5b13 req-c5e32978-a41d-482b-b369-23d4dbc7abdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba797bea-019f-4129-a489-762f4bf2efae", "name": "network-vif-plugged", "status": "completed", "tag": "b650093c-1999-4638-9b53-a040d3edce26"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:47:26.356762 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-6319fdf5-6ffa-40b3-9189-e6dbfcba5b13 req-c5e32978-a41d-482b-b369-23d4dbc7abdf service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:26.357280 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-6319fdf5-6ffa-40b3-9189-e6dbfcba5b13 req-c5e32978-a41d-482b-b369-23d4dbc7abdf service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:26.358023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-6319fdf5-6ffa-40b3-9189-e6dbfcba5b13 req-c5e32978-a41d-482b-b369-23d4dbc7abdf service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:26.372356 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-6319fdf5-6ffa-40b3-9189-e6dbfcba5b13 req-c5e32978-a41d-482b-b369-23d4dbc7abdf service nova] Creating event network-vif-plugged:b650093c-1999-4638-9b53-a040d3edce26 for instance ba797bea-019f-4129-a489-762f4bf2efae on hv-cinder-85069 Aug 17 19:47:26.378833 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-6319fdf5-6ffa-40b3-9189-e6dbfcba5b13 req-c5e32978-a41d-482b-b369-23d4dbc7abdf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048765 Aug 17 19:47:26.380807 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 414/822] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:47:26.435093 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-9c3ef6ad-d9fe-48c3-a650-b5bf695fd152 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:26.435785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9c3ef6ad-d9fe-48c3-a650-b5bf695fd152 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:26.442285 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c3ef6ad-d9fe-48c3-a650-b5bf695fd152 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:26.442942 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c3ef6ad-d9fe-48c3-a650-b5bf695fd152 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:26.443515 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c3ef6ad-d9fe-48c3-a650-b5bf695fd152 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:26.444375 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c3ef6ad-d9fe-48c3-a650-b5bf695fd152 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:26.445022 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c3ef6ad-d9fe-48c3-a650-b5bf695fd152 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:26.445626 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9c3ef6ad-d9fe-48c3-a650-b5bf695fd152 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:26.658608 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9c3ef6ad-d9fe-48c3-a650-b5bf695fd152 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:26.666167 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-9c3ef6ad-d9fe-48c3-a650-b5bf695fd152 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1318 microversion: 2.1 time: 0.235579 Aug 17 19:47:26.666731 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 409/823] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:26 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:27.001767 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f9f2b106-1e8f-4427-9d3d-6e95c7e54221 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:27.002377 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f9f2b106-1e8f-4427-9d3d-6e95c7e54221 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:27.008437 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f9f2b106-1e8f-4427-9d3d-6e95c7e54221 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:27.008947 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f9f2b106-1e8f-4427-9d3d-6e95c7e54221 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:27.009427 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f9f2b106-1e8f-4427-9d3d-6e95c7e54221 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:27.010126 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f9f2b106-1e8f-4427-9d3d-6e95c7e54221 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:27.010562 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f9f2b106-1e8f-4427-9d3d-6e95c7e54221 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:27.010988 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f9f2b106-1e8f-4427-9d3d-6e95c7e54221 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:27.089298 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.objects.instance [None req-f9f2b106-1e8f-4427-9d3d-6e95c7e54221 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lazy-loading 'services' on Instance uuid 78428449-8788-42ec-bdb0-1ee8723c3ea3 {{(pid=132531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:47:27.157650 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f9f2b106-1e8f-4427-9d3d-6e95c7e54221 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/os-volume_attachments/af803c4c-9b4d-460a-9057-0a568ff1b0b3" status: 202 len: 0 microversion: 2.1 time: 0.160452 Aug 17 19:47:27.158251 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 415/824] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 17 19:47:26 2022] DELETE /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/os-volume_attachments/af803c4c-9b4d-460a-9057-0a568ff1b0b3 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:47:27.166584 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1f322e79-c8a9-4012-a59e-9269e9012be5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:27.168750 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1f322e79-c8a9-4012-a59e-9269e9012be5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:27.175126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1f322e79-c8a9-4012-a59e-9269e9012be5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:27.175599 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1f322e79-c8a9-4012-a59e-9269e9012be5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:27.176028 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1f322e79-c8a9-4012-a59e-9269e9012be5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:27.176706 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1f322e79-c8a9-4012-a59e-9269e9012be5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:27.177150 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1f322e79-c8a9-4012-a59e-9269e9012be5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:27.177601 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1f322e79-c8a9-4012-a59e-9269e9012be5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:27.205958 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1f322e79-c8a9-4012-a59e-9269e9012be5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043255 Aug 17 19:47:27.206429 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 410/825] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:47:27 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:47:27.687468 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-30b59b39-bab1-4890-93ef-1eac40e4e45c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:27.688170 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-30b59b39-bab1-4890-93ef-1eac40e4e45c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:27.694276 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-30b59b39-bab1-4890-93ef-1eac40e4e45c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:27.694760 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-30b59b39-bab1-4890-93ef-1eac40e4e45c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:27.695196 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-30b59b39-bab1-4890-93ef-1eac40e4e45c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:27.695886 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-30b59b39-bab1-4890-93ef-1eac40e4e45c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:27.696343 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-30b59b39-bab1-4890-93ef-1eac40e4e45c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:27.696769 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-30b59b39-bab1-4890-93ef-1eac40e4e45c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:27.832550 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-30b59b39-bab1-4890-93ef-1eac40e4e45c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:27.839883 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-30b59b39-bab1-4890-93ef-1eac40e4e45c tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1318 microversion: 2.1 time: 0.156712 Aug 17 19:47:27.840430 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 416/826] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:27 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:28.218977 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d410c3c0-d97f-4cd4-9c9b-38c47a0bd7ee tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:28.221747 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d410c3c0-d97f-4cd4-9c9b-38c47a0bd7ee tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:28.228057 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d410c3c0-d97f-4cd4-9c9b-38c47a0bd7ee tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:28.228533 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d410c3c0-d97f-4cd4-9c9b-38c47a0bd7ee tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:28.228982 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d410c3c0-d97f-4cd4-9c9b-38c47a0bd7ee tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:28.229785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d410c3c0-d97f-4cd4-9c9b-38c47a0bd7ee tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:28.230242 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d410c3c0-d97f-4cd4-9c9b-38c47a0bd7ee tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:28.230669 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d410c3c0-d97f-4cd4-9c9b-38c47a0bd7ee tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:28.261484 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d410c3c0-d97f-4cd4-9c9b-38c47a0bd7ee tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046941 Aug 17 19:47:28.262513 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 411/827] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:47:28 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:47:28.860961 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-dc93aed8-93d1-4eff-82f2-356ef1115974 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:28.861597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-dc93aed8-93d1-4eff-82f2-356ef1115974 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:28.863937 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:47:28.864589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=6 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:47:28.870233 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dc93aed8-93d1-4eff-82f2-356ef1115974 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:28.870705 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dc93aed8-93d1-4eff-82f2-356ef1115974 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:28.871168 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dc93aed8-93d1-4eff-82f2-356ef1115974 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:28.871842 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dc93aed8-93d1-4eff-82f2-356ef1115974 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:28.872284 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dc93aed8-93d1-4eff-82f2-356ef1115974 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:28.872734 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dc93aed8-93d1-4eff-82f2-356ef1115974 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:28.999023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-dc93aed8-93d1-4eff-82f2-356ef1115974 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:29.007006 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-dc93aed8-93d1-4eff-82f2-356ef1115974 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1506 microversion: 2.1 time: 0.149884 Aug 17 19:47:29.007571 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 417/828] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:28 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:47:29.275977 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-23354503-5d0f-44c3-911a-260bb623c068 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:29.278141 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-23354503-5d0f-44c3-911a-260bb623c068 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:29.280164 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:47:29.285340 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-23354503-5d0f-44c3-911a-260bb623c068 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:29.285830 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-23354503-5d0f-44c3-911a-260bb623c068 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:29.286270 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-23354503-5d0f-44c3-911a-260bb623c068 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:29.286965 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-23354503-5d0f-44c3-911a-260bb623c068 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:29.287423 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-23354503-5d0f-44c3-911a-260bb623c068 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:29.287848 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-23354503-5d0f-44c3-911a-260bb623c068 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:29.318797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-23354503-5d0f-44c3-911a-260bb623c068 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047011 Aug 17 19:47:29.319357 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 412/829] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:47:29 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 19:47:29.385167 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d4866ffd-0598-49e8-a2cb-b4c4ab0c26fd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:29.385997 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d4866ffd-0598-49e8-a2cb-b4c4ab0c26fd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:29.392634 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4866ffd-0598-49e8-a2cb-b4c4ab0c26fd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:29.393121 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4866ffd-0598-49e8-a2cb-b4c4ab0c26fd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:29.393885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4866ffd-0598-49e8-a2cb-b4c4ab0c26fd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:29.394614 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4866ffd-0598-49e8-a2cb-b4c4ab0c26fd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:29.395071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4866ffd-0598-49e8-a2cb-b4c4ab0c26fd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:29.395495 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-d4866ffd-0598-49e8-a2cb-b4c4ab0c26fd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:29.424635 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d4866ffd-0598-49e8-a2cb-b4c4ab0c26fd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:47:29.499561 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d4866ffd-0598-49e8-a2cb-b4c4ab0c26fd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 204 len: 0 microversion: 2.1 time: 0.117891 Aug 17 19:47:29.500137 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 418/830] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:47:29 2022] DELETE /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:47:29.508760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-109031b4-3cae-4eee-98b3-e7a90bb1079f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:29.509428 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-109031b4-3cae-4eee-98b3-e7a90bb1079f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:29.516059 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-109031b4-3cae-4eee-98b3-e7a90bb1079f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:29.516546 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-109031b4-3cae-4eee-98b3-e7a90bb1079f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:29.516982 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-109031b4-3cae-4eee-98b3-e7a90bb1079f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:29.517823 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-109031b4-3cae-4eee-98b3-e7a90bb1079f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:29.518329 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-109031b4-3cae-4eee-98b3-e7a90bb1079f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:29.518755 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-109031b4-3cae-4eee-98b3-e7a90bb1079f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:29.650518 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-109031b4-3cae-4eee-98b3-e7a90bb1079f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:29.657975 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-109031b4-3cae-4eee-98b3-e7a90bb1079f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1681 microversion: 2.1 time: 0.152976 Aug 17 19:47:29.658536 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 413/831] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:29 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:47:30.679789 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4e53043b-1872-4902-b853-332aeea6b01a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:30.680477 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-4e53043b-1872-4902-b853-332aeea6b01a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:30.686786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e53043b-1872-4902-b853-332aeea6b01a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:30.687209 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e53043b-1872-4902-b853-332aeea6b01a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:30.687637 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e53043b-1872-4902-b853-332aeea6b01a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:30.688315 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e53043b-1872-4902-b853-332aeea6b01a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:30.688760 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e53043b-1872-4902-b853-332aeea6b01a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:30.689180 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e53043b-1872-4902-b853-332aeea6b01a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:30.820301 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4e53043b-1872-4902-b853-332aeea6b01a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:30.824117 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:47:30.829273 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-4e53043b-1872-4902-b853-332aeea6b01a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1681 microversion: 2.1 time: 0.153660 Aug 17 19:47:30.829839 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 419/832] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:30 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:31.850734 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-16041d96-ea23-4b03-8c7b-972fa44e95ef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:31.851493 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-16041d96-ea23-4b03-8c7b-972fa44e95ef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:31.859489 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-16041d96-ea23-4b03-8c7b-972fa44e95ef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:31.860737 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-16041d96-ea23-4b03-8c7b-972fa44e95ef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:31.861306 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-16041d96-ea23-4b03-8c7b-972fa44e95ef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:31.862305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-16041d96-ea23-4b03-8c7b-972fa44e95ef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:31.862828 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-16041d96-ea23-4b03-8c7b-972fa44e95ef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:31.863474 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-16041d96-ea23-4b03-8c7b-972fa44e95ef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:31.999395 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-16041d96-ea23-4b03-8c7b-972fa44e95ef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:32.007482 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-16041d96-ea23-4b03-8c7b-972fa44e95ef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 200 len: 1681 microversion: 2.1 time: 0.161399 Aug 17 19:47:32.008049 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 414/833] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:31 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:32.408615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-6fca8166-7629-4eeb-8bb0-28a8ecd04caf req-bc289397-5f03-49fc-b86e-8bcb40d07c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78428449-8788-42ec-bdb0-1ee8723c3ea3", "name": "network-vif-deleted", "tag": "4ec02703-f8ea-4535-b9ae-1509e13b37e5"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:47:32.423181 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-6fca8166-7629-4eeb-8bb0-28a8ecd04caf req-bc289397-5f03-49fc-b86e-8bcb40d07c43 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:32.423665 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-6fca8166-7629-4eeb-8bb0-28a8ecd04caf req-bc289397-5f03-49fc-b86e-8bcb40d07c43 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:32.424287 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-6fca8166-7629-4eeb-8bb0-28a8ecd04caf req-bc289397-5f03-49fc-b86e-8bcb40d07c43 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:32.437800 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-6fca8166-7629-4eeb-8bb0-28a8ecd04caf req-bc289397-5f03-49fc-b86e-8bcb40d07c43 service nova] Creating event network-vif-deleted:4ec02703-f8ea-4535-b9ae-1509e13b37e5 for instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 on hv-cinder-85069 Aug 17 19:47:32.442605 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-6fca8166-7629-4eeb-8bb0-28a8ecd04caf req-bc289397-5f03-49fc-b86e-8bcb40d07c43 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038688 Aug 17 19:47:32.443184 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 420/834] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:47:33.028593 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-714ff89c-0df2-4f8a-94b6-497f40d4b4ec tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:33.029353 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-714ff89c-0df2-4f8a-94b6-497f40d4b4ec tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:33.038322 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-714ff89c-0df2-4f8a-94b6-497f40d4b4ec tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:33.038814 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-714ff89c-0df2-4f8a-94b6-497f40d4b4ec tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:33.039252 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-714ff89c-0df2-4f8a-94b6-497f40d4b4ec tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:33.039958 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-714ff89c-0df2-4f8a-94b6-497f40d4b4ec tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:33.040410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-714ff89c-0df2-4f8a-94b6-497f40d4b4ec tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:33.040834 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-714ff89c-0df2-4f8a-94b6-497f40d4b4ec tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:33.057488 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-714ff89c-0df2-4f8a-94b6-497f40d4b4ec tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-714ff89c-0df2-4f8a-94b6-497f40d4b4ec tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 HTTP/1.1 Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:47:33.059316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:47:33.060897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:47:33.060897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:47:33.060897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:47:33.060897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:47:33.060897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:47:33.060897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:47:33.060897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:47:33.060897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:47:33.060897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:47:33.060897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:47:33.060897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:47:33.060897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '78428449-8788-42ec-bdb0-1ee8723c3ea3'} Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:47:33.061753 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:47:33.063519 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:47:33.064635 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-714ff89c-0df2-4f8a-94b6-497f40d4b4ec tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 404 to user: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:47:33.064635 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-714ff89c-0df2-4f8a-94b6-497f40d4b4ec tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 404 len: 111 microversion: 2.1 time: 0.036571 Aug 17 19:47:33.064635 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 415/835] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:33 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:47:33.070754 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-faaa1a0b-0145-4169-a07c-4eca2db0c062 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '.version_select at 0x7f3689f02c10>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:33.090584 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-faaa1a0b-0145-4169-a07c-4eca2db0c062 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-551965545" status: 202 len: 0 microversion: 2.1 time: 0.023909 Aug 17 19:47:33.091154 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 421/836] 10.222.0.59 () {58 vars in 1218 bytes} [Wed Aug 17 19:47:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-551965545 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:47:33.740628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5a15c349-6806-4124-bf34-878cf361484c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: .version_select at 0x7f3689f4bca0>, body: {"keypair": {"name": "tempest-keypair-183738081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLNATHmC9Sx4MtEaf7+p29etqTp58oUCutPLx8wASZqnILkcYnTgKWaAWvWmG7CgFAgdTVl9vka+yWn8zwixsKsZ8dh2GUtcf5OUZ60EBXqKj0bwXimpotQlVOFYvpcow=="}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:47:33.755676 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-5a15c349-6806-4124-bf34-878cf361484c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for project d48524fb6ff040dcac98b23363268772. Resources: {'key_pairs'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:47:33.759470 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-5a15c349-6806-4124-bf34-878cf361484c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for user 22406c8108a4408aa39c5d174d032e20 and project d48524fb6ff040dcac98b23363268772. Resources: {'key_pairs'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:47:33.780344 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5a15c349-6806-4124-bf34-878cf361484c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043595 Aug 17 19:47:33.780920 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 416/837] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 17 19:47:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:47:35.063058 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1856162608", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04936ff2-1cb2-462b-9dfb-59deb589561c"}], "security_groups": [{"name": "tempest-securitygroup--1786675187"}], "key_name": "tempest-keypair-183738081", "user_data": "}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:47:35.170026 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.network.neutron [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] validate_networks() for [('04936ff2-1cb2-462b-9dfb-59deb589561c', None, None, None, None, None)] {{(pid=132531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:47:35.543966 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Flavor limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:47:35.544392 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Image limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:47:35.544871 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Flavor pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:47:35.545303 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Image pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:47:35.545713 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:47:35.554963 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:35.555437 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:35.555938 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:35.556775 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:35.557371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:35.557803 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:35.590877 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for project d48524fb6ff040dcac98b23363268772. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:47:35.594923 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for user 22406c8108a4408aa39c5d174d032e20 and project d48524fb6ff040dcac98b23363268772. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:47:35.605956 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Going to run 1 instances... {{(pid=132531) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:47:35.608257 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:47:35.654553 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a4f33d4c-a40a-41a5-98f6-7b8450bc8bf2 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.596513 Aug 17 19:47:35.655187 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 422/838] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:47:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:47:35.666348 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-fbc4c5dd-9ee5-4182-bf74-af1f62ff9384 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:35.666968 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-fbc4c5dd-9ee5-4182-bf74-af1f62ff9384 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:35.724058 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-fbc4c5dd-9ee5-4182-bf74-af1f62ff9384 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:35.731784 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-fbc4c5dd-9ee5-4182-bf74-af1f62ff9384 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 200 len: 1241 microversion: 2.1 time: 0.069727 Aug 17 19:47:35.732342 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 417/839] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:35 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:36.755744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-89a9b9c5-68b4-4c3e-aa1f-9b1bb5e22a16 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:36.756496 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-89a9b9c5-68b4-4c3e-aa1f-9b1bb5e22a16 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:36.765024 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-89a9b9c5-68b4-4c3e-aa1f-9b1bb5e22a16 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:36.765540 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-89a9b9c5-68b4-4c3e-aa1f-9b1bb5e22a16 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:36.766018 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-89a9b9c5-68b4-4c3e-aa1f-9b1bb5e22a16 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:36.767218 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-89a9b9c5-68b4-4c3e-aa1f-9b1bb5e22a16 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:36.767668 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-89a9b9c5-68b4-4c3e-aa1f-9b1bb5e22a16 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:36.768084 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-89a9b9c5-68b4-4c3e-aa1f-9b1bb5e22a16 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:36.856605 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-89a9b9c5-68b4-4c3e-aa1f-9b1bb5e22a16 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:36.864009 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-89a9b9c5-68b4-4c3e-aa1f-9b1bb5e22a16 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 200 len: 1299 microversion: 2.1 time: 0.113943 Aug 17 19:47:36.864572 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 423/840] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:36 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 1299 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:37.905946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-9b22e284-621b-4b66-9e8a-f0402f3da483 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:37.907370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-9b22e284-621b-4b66-9e8a-f0402f3da483 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:37.914717 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9b22e284-621b-4b66-9e8a-f0402f3da483 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:37.915212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9b22e284-621b-4b66-9e8a-f0402f3da483 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:37.915685 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9b22e284-621b-4b66-9e8a-f0402f3da483 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:37.916548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9b22e284-621b-4b66-9e8a-f0402f3da483 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:37.917050 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9b22e284-621b-4b66-9e8a-f0402f3da483 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:37.917661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-9b22e284-621b-4b66-9e8a-f0402f3da483 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:37.932459 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-47d5b62d-dd2d-4825-a8ab-08ded3fa269f req-7d57f0f0-f1c4-4e1e-b588-69ecae8cb947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2abccd0-4628-4403-bab1-66eac1ca2712", "tag": "97c7dd3c-ccbc-4beb-ba5e-a1625fd4f1c0"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:47:37.943971 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-47d5b62d-dd2d-4825-a8ab-08ded3fa269f req-7d57f0f0-f1c4-4e1e-b588-69ecae8cb947 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:37.944453 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-47d5b62d-dd2d-4825-a8ab-08ded3fa269f req-7d57f0f0-f1c4-4e1e-b588-69ecae8cb947 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:37.944884 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-47d5b62d-dd2d-4825-a8ab-08ded3fa269f req-7d57f0f0-f1c4-4e1e-b588-69ecae8cb947 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:37.963361 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-47d5b62d-dd2d-4825-a8ab-08ded3fa269f req-7d57f0f0-f1c4-4e1e-b588-69ecae8cb947 service nova] Creating event network-changed:97c7dd3c-ccbc-4beb-ba5e-a1625fd4f1c0 for instance b2abccd0-4628-4403-bab1-66eac1ca2712 on hv-cinder-85069 Aug 17 19:47:37.974508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-47d5b62d-dd2d-4825-a8ab-08ded3fa269f req-7d57f0f0-f1c4-4e1e-b588-69ecae8cb947 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045878 Aug 17 19:47:37.975396 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 424/841] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:47:38.066213 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-9b22e284-621b-4b66-9e8a-f0402f3da483 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:38.073885 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-9b22e284-621b-4b66-9e8a-f0402f3da483 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 200 len: 1367 microversion: 2.1 time: 0.192060 Aug 17 19:47:38.074447 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 418/842] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:37 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:39.096300 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ccec6ba3-9de0-455f-8452-04cd7eba94ca tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:39.096914 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ccec6ba3-9de0-455f-8452-04cd7eba94ca tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:39.103023 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ccec6ba3-9de0-455f-8452-04cd7eba94ca tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:39.103508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ccec6ba3-9de0-455f-8452-04cd7eba94ca tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:39.103956 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ccec6ba3-9de0-455f-8452-04cd7eba94ca tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:39.104646 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ccec6ba3-9de0-455f-8452-04cd7eba94ca tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:39.105206 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ccec6ba3-9de0-455f-8452-04cd7eba94ca tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:39.105662 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ccec6ba3-9de0-455f-8452-04cd7eba94ca tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:39.231754 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-ccec6ba3-9de0-455f-8452-04cd7eba94ca tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:39.239139 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ccec6ba3-9de0-455f-8452-04cd7eba94ca tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 200 len: 1367 microversion: 2.1 time: 0.148277 Aug 17 19:47:39.239704 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 425/843] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:39 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:40.259402 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f6f5a771-27a8-4b3c-af27-97c0cb4980d9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:40.260017 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f6f5a771-27a8-4b3c-af27-97c0cb4980d9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:40.267029 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6f5a771-27a8-4b3c-af27-97c0cb4980d9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:40.267508 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6f5a771-27a8-4b3c-af27-97c0cb4980d9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:40.267937 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6f5a771-27a8-4b3c-af27-97c0cb4980d9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:40.268630 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6f5a771-27a8-4b3c-af27-97c0cb4980d9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:40.269080 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6f5a771-27a8-4b3c-af27-97c0cb4980d9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:40.269538 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6f5a771-27a8-4b3c-af27-97c0cb4980d9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:40.403173 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f6f5a771-27a8-4b3c-af27-97c0cb4980d9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:40.410529 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f6f5a771-27a8-4b3c-af27-97c0cb4980d9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 200 len: 1367 microversion: 2.1 time: 0.154963 Aug 17 19:47:40.411091 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 419/844] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:40 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:41.431137 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f03c1eee-3c0c-43b4-ad3d-5865ce89c6c7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:41.431761 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f03c1eee-3c0c-43b4-ad3d-5865ce89c6c7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:41.438227 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f03c1eee-3c0c-43b4-ad3d-5865ce89c6c7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:41.438712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f03c1eee-3c0c-43b4-ad3d-5865ce89c6c7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:41.439149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f03c1eee-3c0c-43b4-ad3d-5865ce89c6c7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:41.439838 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f03c1eee-3c0c-43b4-ad3d-5865ce89c6c7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:41.440295 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f03c1eee-3c0c-43b4-ad3d-5865ce89c6c7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:41.440720 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f03c1eee-3c0c-43b4-ad3d-5865ce89c6c7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:41.568139 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-f03c1eee-3c0c-43b4-ad3d-5865ce89c6c7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:41.575664 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f03c1eee-3c0c-43b4-ad3d-5865ce89c6c7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 200 len: 1367 microversion: 2.1 time: 0.148469 Aug 17 19:47:41.576213 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 426/845] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:41 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:42.290156 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-76861023-555b-4067-8663-d46c71299754 req-6f8f8ef1-8563-4646-b325-3a76e6e29df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2abccd0-4628-4403-bab1-66eac1ca2712", "name": "network-vif-plugged", "status": "completed", "tag": "97c7dd3c-ccbc-4beb-ba5e-a1625fd4f1c0"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:47:42.301105 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-76861023-555b-4067-8663-d46c71299754 req-6f8f8ef1-8563-4646-b325-3a76e6e29df4 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:42.301618 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-76861023-555b-4067-8663-d46c71299754 req-6f8f8ef1-8563-4646-b325-3a76e6e29df4 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:42.302053 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-76861023-555b-4067-8663-d46c71299754 req-6f8f8ef1-8563-4646-b325-3a76e6e29df4 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:42.312998 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-76861023-555b-4067-8663-d46c71299754 req-6f8f8ef1-8563-4646-b325-3a76e6e29df4 service nova] Creating event network-vif-plugged:97c7dd3c-ccbc-4beb-ba5e-a1625fd4f1c0 for instance b2abccd0-4628-4403-bab1-66eac1ca2712 on hv-cinder-85069 Aug 17 19:47:42.318465 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-76861023-555b-4067-8663-d46c71299754 req-6f8f8ef1-8563-4646-b325-3a76e6e29df4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031980 Aug 17 19:47:42.319299 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 420/846] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:47:42.596896 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a1e0eedb-aab0-46f0-8898-fd8c7de4c5c1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:42.597480 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a1e0eedb-aab0-46f0-8898-fd8c7de4c5c1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:42.603810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a1e0eedb-aab0-46f0-8898-fd8c7de4c5c1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:42.604293 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a1e0eedb-aab0-46f0-8898-fd8c7de4c5c1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:42.604728 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a1e0eedb-aab0-46f0-8898-fd8c7de4c5c1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:42.605441 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a1e0eedb-aab0-46f0-8898-fd8c7de4c5c1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:42.605896 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a1e0eedb-aab0-46f0-8898-fd8c7de4c5c1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:42.606668 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a1e0eedb-aab0-46f0-8898-fd8c7de4c5c1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:42.734332 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-a1e0eedb-aab0-46f0-8898-fd8c7de4c5c1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:42.742261 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a1e0eedb-aab0-46f0-8898-fd8c7de4c5c1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 200 len: 1367 microversion: 2.1 time: 0.149878 Aug 17 19:47:42.742810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 427/847] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:42 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:43.763178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-0413bcc2-601f-464e-adbb-63a0b8656fab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:43.763868 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-0413bcc2-601f-464e-adbb-63a0b8656fab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:43.770702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0413bcc2-601f-464e-adbb-63a0b8656fab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:43.771200 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0413bcc2-601f-464e-adbb-63a0b8656fab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:43.771631 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0413bcc2-601f-464e-adbb-63a0b8656fab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:43.772309 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0413bcc2-601f-464e-adbb-63a0b8656fab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:43.772754 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0413bcc2-601f-464e-adbb-63a0b8656fab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:43.773172 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0413bcc2-601f-464e-adbb-63a0b8656fab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:43.911403 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0413bcc2-601f-464e-adbb-63a0b8656fab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:43.919141 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-0413bcc2-601f-464e-adbb-63a0b8656fab tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 200 len: 1367 microversion: 2.1 time: 0.160524 Aug 17 19:47:43.919891 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 421/848] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:43 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:44.218615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-bb247b92-e13a-4cf5-b6cf-9f1e218c9ee0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b592dba3-a5a1-4395-88a0-23285b8dc3d4", "device": "/dev/sdb"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:47:44.221535 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-bb247b92-e13a-4cf5-b6cf-9f1e218c9ee0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:44.227945 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bb247b92-e13a-4cf5-b6cf-9f1e218c9ee0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:44.228460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bb247b92-e13a-4cf5-b6cf-9f1e218c9ee0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:44.228900 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bb247b92-e13a-4cf5-b6cf-9f1e218c9ee0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:44.229616 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bb247b92-e13a-4cf5-b6cf-9f1e218c9ee0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:44.230071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bb247b92-e13a-4cf5-b6cf-9f1e218c9ee0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:44.230496 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-bb247b92-e13a-4cf5-b6cf-9f1e218c9ee0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:44.465183 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-bb247b92-e13a-4cf5-b6cf-9f1e218c9ee0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "POST /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250284 Aug 17 19:47:44.465808 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 428/849] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:47:44 2022] POST /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:47:44.939779 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-0478800b-3488-4812-817f-9ac039b59ebe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:44.940385 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-0478800b-3488-4812-817f-9ac039b59ebe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:44.946732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0478800b-3488-4812-817f-9ac039b59ebe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:44.947203 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0478800b-3488-4812-817f-9ac039b59ebe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:44.947661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0478800b-3488-4812-817f-9ac039b59ebe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:44.948600 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0478800b-3488-4812-817f-9ac039b59ebe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:44.949048 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0478800b-3488-4812-817f-9ac039b59ebe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:44.949518 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-0478800b-3488-4812-817f-9ac039b59ebe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:45.074202 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-0478800b-3488-4812-817f-9ac039b59ebe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:47:45.082048 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-0478800b-3488-4812-817f-9ac039b59ebe tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 200 len: 1557 microversion: 2.1 time: 0.146111 Aug 17 19:47:45.082610 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 422/850] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:47:44 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 1557 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:47:45.103861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-42e131bf-b006-452d-a42e-835e490548d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:47:45.104381 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-42e131bf-b006-452d-a42e-835e490548d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:47:45.110520 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-42e131bf-b006-452d-a42e-835e490548d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:45.111003 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-42e131bf-b006-452d-a42e-835e490548d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:45.111438 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-42e131bf-b006-452d-a42e-835e490548d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:45.112125 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-42e131bf-b006-452d-a42e-835e490548d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:45.112580 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-42e131bf-b006-452d-a42e-835e490548d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:45.113005 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-42e131bf-b006-452d-a42e-835e490548d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:45.188114 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-42e131bf-b006-452d-a42e-835e490548d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088867 Aug 17 19:47:45.188711 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 429/851] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 17 19:47:45 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:47:46.087689 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-8988ea04-6d0b-4b76-954e-816c95b8c8d8 req-aa4f007b-f7cb-4b39-94c2-a87043ecc099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2abccd0-4628-4403-bab1-66eac1ca2712", "tag": "97c7dd3c-ccbc-4beb-ba5e-a1625fd4f1c0"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:47:46.092662 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=6 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:47:46.099198 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-8988ea04-6d0b-4b76-954e-816c95b8c8d8 req-aa4f007b-f7cb-4b39-94c2-a87043ecc099 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:47:46.099774 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-8988ea04-6d0b-4b76-954e-816c95b8c8d8 req-aa4f007b-f7cb-4b39-94c2-a87043ecc099 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:47:46.100282 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-8988ea04-6d0b-4b76-954e-816c95b8c8d8 req-aa4f007b-f7cb-4b39-94c2-a87043ecc099 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:47:46.104099 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=100 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:47:46.112600 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-8988ea04-6d0b-4b76-954e-816c95b8c8d8 req-aa4f007b-f7cb-4b39-94c2-a87043ecc099 service nova] Creating event network-changed:97c7dd3c-ccbc-4beb-ba5e-a1625fd4f1c0 for instance b2abccd0-4628-4403-bab1-66eac1ca2712 on hv-cinder-85069 Aug 17 19:47:46.118030 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-8988ea04-6d0b-4b76-954e-816c95b8c8d8 req-aa4f007b-f7cb-4b39-94c2-a87043ecc099 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034183 Aug 17 19:47:46.118638 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 423/852] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:48:05.022959 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:05.023732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=6 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:05.024488 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:05.025463 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:05.029790 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ff895a15-8475-4cd7-a490-8db2c47f8edc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:05.030292 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ff895a15-8475-4cd7-a490-8db2c47f8edc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:05.038534 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ff895a15-8475-4cd7-a490-8db2c47f8edc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:05.038942 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ff895a15-8475-4cd7-a490-8db2c47f8edc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:05.039380 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ff895a15-8475-4cd7-a490-8db2c47f8edc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:05.040074 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ff895a15-8475-4cd7-a490-8db2c47f8edc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:05.040538 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ff895a15-8475-4cd7-a490-8db2c47f8edc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:05.040965 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ff895a15-8475-4cd7-a490-8db2c47f8edc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:05.124782 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.objects.instance [None req-ff895a15-8475-4cd7-a490-8db2c47f8edc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lazy-loading 'services' on Instance uuid ba797bea-019f-4129-a489-762f4bf2efae {{(pid=132531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:48:05.195836 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ff895a15-8475-4cd7-a490-8db2c47f8edc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae/os-volume_attachments/b592dba3-a5a1-4395-88a0-23285b8dc3d4" status: 202 len: 0 microversion: 2.1 time: 0.173903 Aug 17 19:48:05.196446 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 430/853] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 17 19:48:05 2022] DELETE /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae/os-volume_attachments/b592dba3-a5a1-4395-88a0-23285b8dc3d4 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:48:06.317500 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:06.321915 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1d2ff5fe-b3ed-4d01-b340-3ea854d888a3 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:06.322617 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1d2ff5fe-b3ed-4d01-b340-3ea854d888a3 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:06.330309 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1d2ff5fe-b3ed-4d01-b340-3ea854d888a3 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:06.330795 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1d2ff5fe-b3ed-4d01-b340-3ea854d888a3 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:06.331235 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1d2ff5fe-b3ed-4d01-b340-3ea854d888a3 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:06.331929 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1d2ff5fe-b3ed-4d01-b340-3ea854d888a3 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:06.332387 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1d2ff5fe-b3ed-4d01-b340-3ea854d888a3 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:06.332816 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1d2ff5fe-b3ed-4d01-b340-3ea854d888a3 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:06.360670 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1d2ff5fe-b3ed-4d01-b340-3ea854d888a3 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Going to try to terminate instance {{(pid=132530) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:48:06.434714 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1d2ff5fe-b3ed-4d01-b340-3ea854d888a3 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 204 len: 0 microversion: 2.1 time: 0.118656 Aug 17 19:48:06.435450 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 424/854] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:48:06 2022] DELETE /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:48:06.445636 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-964b4214-61d5-4fbd-9e3e-017598a7b8ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:06.446338 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-964b4214-61d5-4fbd-9e3e-017598a7b8ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:06.452695 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-964b4214-61d5-4fbd-9e3e-017598a7b8ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:06.453176 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-964b4214-61d5-4fbd-9e3e-017598a7b8ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:06.453651 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-964b4214-61d5-4fbd-9e3e-017598a7b8ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:06.454871 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-964b4214-61d5-4fbd-9e3e-017598a7b8ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:06.455326 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-964b4214-61d5-4fbd-9e3e-017598a7b8ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:06.455751 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-964b4214-61d5-4fbd-9e3e-017598a7b8ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:06.810551 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-964b4214-61d5-4fbd-9e3e-017598a7b8ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:06.818470 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-964b4214-61d5-4fbd-9e3e-017598a7b8ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1512 microversion: 2.1 time: 0.378458 Aug 17 19:48:06.819029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 431/855] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:06 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:07.840920 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-8b41b39d-6668-493c-ac46-3c4dc1822220 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:07.841650 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-8b41b39d-6668-493c-ac46-3c4dc1822220 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:07.848557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8b41b39d-6668-493c-ac46-3c4dc1822220 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:07.849034 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8b41b39d-6668-493c-ac46-3c4dc1822220 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:07.849623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8b41b39d-6668-493c-ac46-3c4dc1822220 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:07.850307 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8b41b39d-6668-493c-ac46-3c4dc1822220 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:07.850761 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8b41b39d-6668-493c-ac46-3c4dc1822220 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:07.851183 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-8b41b39d-6668-493c-ac46-3c4dc1822220 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:07.977666 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-8b41b39d-6668-493c-ac46-3c4dc1822220 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:07.985101 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-8b41b39d-6668-493c-ac46-3c4dc1822220 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1512 microversion: 2.1 time: 0.148313 Aug 17 19:48:07.985651 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 425/856] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:07 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:08.613674 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-3cf9327f-47da-4cf4-9f2b-3ca263f64ece req-d1444355-419c-4fc9-92b8-11f5e1d19d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba797bea-019f-4129-a489-762f4bf2efae", "name": "network-vif-deleted", "tag": "b650093c-1999-4638-9b53-a040d3edce26"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:48:08.625132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-3cf9327f-47da-4cf4-9f2b-3ca263f64ece req-d1444355-419c-4fc9-92b8-11f5e1d19d06 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:08.626214 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-3cf9327f-47da-4cf4-9f2b-3ca263f64ece req-d1444355-419c-4fc9-92b8-11f5e1d19d06 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:08.626658 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-3cf9327f-47da-4cf4-9f2b-3ca263f64ece req-d1444355-419c-4fc9-92b8-11f5e1d19d06 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:08.639959 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-3cf9327f-47da-4cf4-9f2b-3ca263f64ece req-d1444355-419c-4fc9-92b8-11f5e1d19d06 service nova] Creating event network-vif-deleted:b650093c-1999-4638-9b53-a040d3edce26 for instance ba797bea-019f-4129-a489-762f4bf2efae on hv-cinder-85069 Aug 17 19:48:08.645083 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-3cf9327f-47da-4cf4-9f2b-3ca263f64ece req-d1444355-419c-4fc9-92b8-11f5e1d19d06 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035716 Aug 17 19:48:08.645705 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 432/857] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:48:09.006402 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:09.007025 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:09.013626 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:09.014108 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:09.014549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:09.015242 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:09.015699 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:09.016124 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:09.048632 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:09.049411 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:09.050046 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:09.050517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lazy-loading 'fault' on Instance uuid ba797bea-019f-4129-a489-762f4bf2efae {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:48:09.093407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:09.100778 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-469a1740-4557-4ccb-b161-f9e6510a0e75 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 200 len: 1308 microversion: 2.1 time: 0.098242 Aug 17 19:48:09.101647 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 426/858] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:09 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:10.122812 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-77c3f3b5-9f00-46b5-99e1-3bb1d090b7ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:10.123444 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-77c3f3b5-9f00-46b5-99e1-3bb1d090b7ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: ba797bea-019f-4129-a489-762f4bf2efae] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:10.130648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-77c3f3b5-9f00-46b5-99e1-3bb1d090b7ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:10.131131 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-77c3f3b5-9f00-46b5-99e1-3bb1d090b7ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:10.131571 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-77c3f3b5-9f00-46b5-99e1-3bb1d090b7ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:10.132256 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-77c3f3b5-9f00-46b5-99e1-3bb1d090b7ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:10.132712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-77c3f3b5-9f00-46b5-99e1-3bb1d090b7ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:10.133139 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-77c3f3b5-9f00-46b5-99e1-3bb1d090b7ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:10.146215 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-77c3f3b5-9f00-46b5-99e1-3bb1d090b7ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] HTTP exception thrown: Instance ba797bea-019f-4129-a489-762f4bf2efae could not be found. Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-77c3f3b5-9f00-46b5-99e1-3bb1d090b7ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Request method failure captured: Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae HTTP/1.1 Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UXELUMHGc3h2XjMb6zgEBqp84D4n0iC97S-0wd2PA-GWwDLYja4vc_U1adC6nm4SsB8WwImRLnzVwITmnYvasu6VkJULrY44A648a0fslFnqpR1cIO89P9Uj5JPZ0Cugf_q_cP8mnGqIrUwJh4mSncYtvZ0d1gvV3irfxI3GJqEDJ0 Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: e1bc20a6ee5c4e61ab2f8b0683543ddc Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1991522373 Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:48:10.147801 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:48:10.149451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e1bc20a6ee5c4e61ab2f8b0683543ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1bc20a6ee5c4e61ab2f8b0683543ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e1bc20a6ee5c4e61ab2f8b0683543ddc", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1bc20a6ee5c4e61ab2f8b0683543ddc"}]}] Aug 17 19:48:10.149451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-VolumesSnapshotTestJSON-1991522373 Aug 17 19:48:10.149451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: e1bc20a6ee5c4e61ab2f8b0683543ddc Aug 17 19:48:10.149451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1991522373 Aug 17 19:48:10.149451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-VolumesSnapshotTestJSON-1991522373-project Aug 17 19:48:10.149451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:48:10.149451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:48:10.149451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 285afd956888457d9cd947713e6826ac Aug 17 19:48:10.149451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-VolumesSnapshotTestJSON-1991522373-project Aug 17 19:48:10.149451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:48:10.149451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance ba797bea-019f-4129-a489-762f4bf2efae could not be found. Aug 17 19:48:10.149451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': 'ba797bea-019f-4129-a489-762f4bf2efae'} Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba797bea-019f-4129-a489-762f4bf2efae could not be found. Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:48:10.150577 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba797bea-019f-4129-a489-762f4bf2efae could not be found. Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba797bea-019f-4129-a489-762f4bf2efae could not be found. Aug 17 19:48:10.152108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:10.153589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-77c3f3b5-9f00-46b5-99e1-3bb1d090b7ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Returning 404 to user: Instance ba797bea-019f-4129-a489-762f4bf2efae could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:48:10.153589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-77c3f3b5-9f00-46b5-99e1-3bb1d090b7ec tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae" status: 404 len: 111 microversion: 2.1 time: 0.030645 Aug 17 19:48:10.153589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 433/859] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:10 2022] GET /compute/v2.1/servers/ba797bea-019f-4129-a489-762f4bf2efae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:48:17.912341 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-972096984", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "networks": [{"uuid": "d10cb1f4-6eb1-45b3-ae3e-3bd1476e3af7"}]}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:48:17.965501 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.network.neutron [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] validate_networks() for [('d10cb1f4-6eb1-45b3-ae3e-3bd1476e3af7', None, None, None, None, None)] {{(pid=132530) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:48:18.296671 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Flavor limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:48:18.297620 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Image limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:48:18.298212 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Flavor pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:48:18.298627 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Image pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:48:18.299040 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:48:18.307659 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:18.308169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:18.308605 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:18.309444 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:18.309901 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:18.310330 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:18.327305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Getting quotas for project e1bc20a6ee5c4e61ab2f8b0683543ddc. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:48:18.331168 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Getting quotas for user 285afd956888457d9cd947713e6826ac and project e1bc20a6ee5c4e61ab2f8b0683543ddc. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:48:18.341784 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Going to run 1 instances... {{(pid=132530) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:48:18.343987 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132530) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:48:18.390484 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-fc2f6c43-1442-4726-9403-6a0216c42e16 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.481814 Aug 17 19:48:18.391134 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 427/860] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:48:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:48:18.402339 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-2c6d5d3e-eca7-4f75-83c7-904cb99c563a tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:18.403042 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-2c6d5d3e-eca7-4f75-83c7-904cb99c563a tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:18.460860 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-2c6d5d3e-eca7-4f75-83c7-904cb99c563a tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:18.471181 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-2c6d5d3e-eca7-4f75-83c7-904cb99c563a tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1218 microversion: 2.1 time: 0.073128 Aug 17 19:48:18.471746 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 434/861] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:18 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:19.492229 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b87af474-ef49-4fcb-86db-be882c8ef946 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:19.492843 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b87af474-ef49-4fcb-86db-be882c8ef946 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:19.499369 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b87af474-ef49-4fcb-86db-be882c8ef946 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:19.499848 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b87af474-ef49-4fcb-86db-be882c8ef946 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:19.500818 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b87af474-ef49-4fcb-86db-be882c8ef946 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:19.501544 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b87af474-ef49-4fcb-86db-be882c8ef946 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:19.502089 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b87af474-ef49-4fcb-86db-be882c8ef946 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:19.502512 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b87af474-ef49-4fcb-86db-be882c8ef946 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:19.563236 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b87af474-ef49-4fcb-86db-be882c8ef946 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:19.570794 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b87af474-ef49-4fcb-86db-be882c8ef946 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1276 microversion: 2.1 time: 0.082965 Aug 17 19:48:19.571468 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 428/862] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:19 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1276 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:20.536699 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-90c24ee0-96e7-494e-8765-c941ce86f7f7 req-34b13f9f-4f5a-4d2a-8dc0-6723822df2fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c92c812f-de25-4962-997a-1164f56cbdd1", "tag": "8af61491-719f-4cef-8c81-99a8aa08ac1e"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:48:20.542608 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:20.550357 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-90c24ee0-96e7-494e-8765-c941ce86f7f7 req-34b13f9f-4f5a-4d2a-8dc0-6723822df2fc service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:20.550837 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-90c24ee0-96e7-494e-8765-c941ce86f7f7 req-34b13f9f-4f5a-4d2a-8dc0-6723822df2fc service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:20.551267 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-90c24ee0-96e7-494e-8765-c941ce86f7f7 req-34b13f9f-4f5a-4d2a-8dc0-6723822df2fc service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:20.564074 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-90c24ee0-96e7-494e-8765-c941ce86f7f7 req-34b13f9f-4f5a-4d2a-8dc0-6723822df2fc service nova] Creating event network-changed:8af61491-719f-4cef-8c81-99a8aa08ac1e for instance c92c812f-de25-4962-997a-1164f56cbdd1 on hv-cinder-85069 Aug 17 19:48:20.569009 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-90c24ee0-96e7-494e-8765-c941ce86f7f7 req-34b13f9f-4f5a-4d2a-8dc0-6723822df2fc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036708 Aug 17 19:48:20.569761 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 435/863] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:48:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:48:20.593724 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3354a246-ce34-4779-b1d5-7febe38c0aea tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:20.595187 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3354a246-ce34-4779-b1d5-7febe38c0aea tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:20.601646 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3354a246-ce34-4779-b1d5-7febe38c0aea tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:20.602125 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3354a246-ce34-4779-b1d5-7febe38c0aea tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:20.602559 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3354a246-ce34-4779-b1d5-7febe38c0aea tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:20.603255 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3354a246-ce34-4779-b1d5-7febe38c0aea tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:20.603796 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3354a246-ce34-4779-b1d5-7febe38c0aea tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:20.604229 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3354a246-ce34-4779-b1d5-7febe38c0aea tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:20.731452 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3354a246-ce34-4779-b1d5-7febe38c0aea tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:20.738880 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3354a246-ce34-4779-b1d5-7febe38c0aea tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1318 microversion: 2.1 time: 0.149118 Aug 17 19:48:20.739884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 429/864] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:20 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:21.761026 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4e504e7d-83ef-4207-a248-4cdad757ccf5 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:21.761795 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-4e504e7d-83ef-4207-a248-4cdad757ccf5 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:21.769202 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e504e7d-83ef-4207-a248-4cdad757ccf5 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:21.769729 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e504e7d-83ef-4207-a248-4cdad757ccf5 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:21.770171 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e504e7d-83ef-4207-a248-4cdad757ccf5 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:21.770879 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e504e7d-83ef-4207-a248-4cdad757ccf5 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:21.771338 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e504e7d-83ef-4207-a248-4cdad757ccf5 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:21.771769 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e504e7d-83ef-4207-a248-4cdad757ccf5 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:21.903264 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4e504e7d-83ef-4207-a248-4cdad757ccf5 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:21.910742 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-4e504e7d-83ef-4207-a248-4cdad757ccf5 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1318 microversion: 2.1 time: 0.154576 Aug 17 19:48:21.911299 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 436/865] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:21 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:22.931809 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-961a1482-31f0-4df6-9f7b-49ba82fdfc8d tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:22.932418 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-961a1482-31f0-4df6-9f7b-49ba82fdfc8d tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:22.938749 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-961a1482-31f0-4df6-9f7b-49ba82fdfc8d tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:22.939219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-961a1482-31f0-4df6-9f7b-49ba82fdfc8d tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:22.939648 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-961a1482-31f0-4df6-9f7b-49ba82fdfc8d tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:22.940322 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-961a1482-31f0-4df6-9f7b-49ba82fdfc8d tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:22.940771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-961a1482-31f0-4df6-9f7b-49ba82fdfc8d tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:22.941185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-961a1482-31f0-4df6-9f7b-49ba82fdfc8d tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:23.070640 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-961a1482-31f0-4df6-9f7b-49ba82fdfc8d tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:23.078265 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-961a1482-31f0-4df6-9f7b-49ba82fdfc8d tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1318 microversion: 2.1 time: 0.150249 Aug 17 19:48:23.079419 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 430/866] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:22 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:24.099434 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-68e9da64-a6fc-4700-9304-1c2c1e622581 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:24.099987 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-68e9da64-a6fc-4700-9304-1c2c1e622581 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:24.106356 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-68e9da64-a6fc-4700-9304-1c2c1e622581 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:24.106837 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-68e9da64-a6fc-4700-9304-1c2c1e622581 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:24.107273 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-68e9da64-a6fc-4700-9304-1c2c1e622581 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:24.107962 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-68e9da64-a6fc-4700-9304-1c2c1e622581 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:24.108417 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-68e9da64-a6fc-4700-9304-1c2c1e622581 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:24.108843 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-68e9da64-a6fc-4700-9304-1c2c1e622581 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:24.238056 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-68e9da64-a6fc-4700-9304-1c2c1e622581 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:24.245379 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-68e9da64-a6fc-4700-9304-1c2c1e622581 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1318 microversion: 2.1 time: 0.149845 Aug 17 19:48:24.245935 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 437/867] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:24 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:25.267586 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e9bfc06a-f248-4664-9cea-6cb81ddf1e74 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:25.268196 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e9bfc06a-f248-4664-9cea-6cb81ddf1e74 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:25.274061 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e9bfc06a-f248-4664-9cea-6cb81ddf1e74 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:25.274537 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e9bfc06a-f248-4664-9cea-6cb81ddf1e74 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:25.274968 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e9bfc06a-f248-4664-9cea-6cb81ddf1e74 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:25.275646 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e9bfc06a-f248-4664-9cea-6cb81ddf1e74 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:25.276094 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e9bfc06a-f248-4664-9cea-6cb81ddf1e74 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:25.276514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e9bfc06a-f248-4664-9cea-6cb81ddf1e74 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:25.406342 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e9bfc06a-f248-4664-9cea-6cb81ddf1e74 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:25.413677 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e9bfc06a-f248-4664-9cea-6cb81ddf1e74 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1318 microversion: 2.1 time: 0.150719 Aug 17 19:48:25.414238 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 431/868] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:25 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:26.434201 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-588ec89d-9f45-4861-ab31-7658d2e04e1b tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:26.434959 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-588ec89d-9f45-4861-ab31-7658d2e04e1b tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:26.444832 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-588ec89d-9f45-4861-ab31-7658d2e04e1b tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:26.445368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-588ec89d-9f45-4861-ab31-7658d2e04e1b tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:26.446116 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-588ec89d-9f45-4861-ab31-7658d2e04e1b tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:26.447287 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-588ec89d-9f45-4861-ab31-7658d2e04e1b tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:26.447780 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-588ec89d-9f45-4861-ab31-7658d2e04e1b tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:26.448755 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-588ec89d-9f45-4861-ab31-7658d2e04e1b tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:26.513970 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-fab0ed0c-f461-4a01-bc4f-227db5c95eb6 req-32f6b3d8-1402-4afe-bd0d-d054090e83af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92c812f-de25-4962-997a-1164f56cbdd1", "name": "network-vif-plugged", "status": "completed", "tag": "8af61491-719f-4cef-8c81-99a8aa08ac1e"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:48:26.524241 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-fab0ed0c-f461-4a01-bc4f-227db5c95eb6 req-32f6b3d8-1402-4afe-bd0d-d054090e83af service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:26.524733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-fab0ed0c-f461-4a01-bc4f-227db5c95eb6 req-32f6b3d8-1402-4afe-bd0d-d054090e83af service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:26.525140 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-fab0ed0c-f461-4a01-bc4f-227db5c95eb6 req-32f6b3d8-1402-4afe-bd0d-d054090e83af service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:26.544526 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-fab0ed0c-f461-4a01-bc4f-227db5c95eb6 req-32f6b3d8-1402-4afe-bd0d-d054090e83af service nova] Creating event network-vif-plugged:8af61491-719f-4cef-8c81-99a8aa08ac1e for instance c92c812f-de25-4962-997a-1164f56cbdd1 on hv-cinder-85069 Aug 17 19:48:26.551022 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-fab0ed0c-f461-4a01-bc4f-227db5c95eb6 req-32f6b3d8-1402-4afe-bd0d-d054090e83af service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040677 Aug 17 19:48:26.553168 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 432/869] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:48:26.589597 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-588ec89d-9f45-4861-ab31-7658d2e04e1b tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:26.598705 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-588ec89d-9f45-4861-ab31-7658d2e04e1b tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1318 microversion: 2.1 time: 0.168319 Aug 17 19:48:26.599483 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 438/870] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:26 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:27.621572 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ca38b6f9-8658-40ab-bd89-9722cf7d8e78 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:27.622268 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ca38b6f9-8658-40ab-bd89-9722cf7d8e78 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:27.628849 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ca38b6f9-8658-40ab-bd89-9722cf7d8e78 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:27.629350 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ca38b6f9-8658-40ab-bd89-9722cf7d8e78 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:27.629782 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ca38b6f9-8658-40ab-bd89-9722cf7d8e78 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:27.630460 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ca38b6f9-8658-40ab-bd89-9722cf7d8e78 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:27.630930 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ca38b6f9-8658-40ab-bd89-9722cf7d8e78 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:27.631353 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ca38b6f9-8658-40ab-bd89-9722cf7d8e78 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:27.760998 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ca38b6f9-8658-40ab-bd89-9722cf7d8e78 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:27.769109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ca38b6f9-8658-40ab-bd89-9722cf7d8e78 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1318 microversion: 2.1 time: 0.152308 Aug 17 19:48:27.769702 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 433/871] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:27 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:28.790175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b6bfd866-3e2a-4545-8d53-5fdb887b52bc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:28.790729 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b6bfd866-3e2a-4545-8d53-5fdb887b52bc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:28.793142 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:28.798658 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6bfd866-3e2a-4545-8d53-5fdb887b52bc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:28.799139 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6bfd866-3e2a-4545-8d53-5fdb887b52bc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:28.799575 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6bfd866-3e2a-4545-8d53-5fdb887b52bc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:28.800259 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6bfd866-3e2a-4545-8d53-5fdb887b52bc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:28.800715 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6bfd866-3e2a-4545-8d53-5fdb887b52bc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:28.801139 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b6bfd866-3e2a-4545-8d53-5fdb887b52bc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:28.927947 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-b6bfd866-3e2a-4545-8d53-5fdb887b52bc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:28.935414 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b6bfd866-3e2a-4545-8d53-5fdb887b52bc tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1507 microversion: 2.1 time: 0.149250 Aug 17 19:48:28.935969 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 439/872] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:28 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:28.956290 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5f2249c1-ee84-4a8b-b709-80a6a9bd22fb tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "293a7b27-fa12-4258-a417-23956eda477b", "device": "/dev/sdb"}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:48:28.959194 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5f2249c1-ee84-4a8b-b709-80a6a9bd22fb tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:28.961138 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:28.961817 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=6 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:28.967828 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5f2249c1-ee84-4a8b-b709-80a6a9bd22fb tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:28.968306 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5f2249c1-ee84-4a8b-b709-80a6a9bd22fb tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:28.969395 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5f2249c1-ee84-4a8b-b709-80a6a9bd22fb tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:28.970087 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5f2249c1-ee84-4a8b-b709-80a6a9bd22fb tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:28.970533 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5f2249c1-ee84-4a8b-b709-80a6a9bd22fb tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:28.970981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5f2249c1-ee84-4a8b-b709-80a6a9bd22fb tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:29.199305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5f2249c1-ee84-4a8b-b709-80a6a9bd22fb tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "POST /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247301 Aug 17 19:48:29.199925 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 434/873] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:48:28 2022] POST /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:48:30.569068 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b0dd3dd0-f773-49f0-8452-a6c4c5b93987 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:30.569630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b0dd3dd0-f773-49f0-8452-a6c4c5b93987 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:30.576241 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b0dd3dd0-f773-49f0-8452-a6c4c5b93987 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:30.576729 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b0dd3dd0-f773-49f0-8452-a6c4c5b93987 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:30.577170 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b0dd3dd0-f773-49f0-8452-a6c4c5b93987 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:30.577889 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b0dd3dd0-f773-49f0-8452-a6c4c5b93987 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:30.578942 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b0dd3dd0-f773-49f0-8452-a6c4c5b93987 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:30.579373 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b0dd3dd0-f773-49f0-8452-a6c4c5b93987 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:30.601531 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b0dd3dd0-f773-49f0-8452-a6c4c5b93987 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/ips" status: 200 len: 150 microversion: 2.1 time: 0.036373 Aug 17 19:48:30.602089 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 440/874] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 17 19:48:30 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:48:31.923114 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3b181b7d-74a2-4da0-82e7-c1d893ae6f24 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58917ffb-dda9-4a1e-b5bb-22308af75f8b"}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:48:31.925600 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3b181b7d-74a2-4da0-82e7-c1d893ae6f24 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:31.931724 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3b181b7d-74a2-4da0-82e7-c1d893ae6f24 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:31.932206 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3b181b7d-74a2-4da0-82e7-c1d893ae6f24 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:31.932643 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3b181b7d-74a2-4da0-82e7-c1d893ae6f24 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:31.933388 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3b181b7d-74a2-4da0-82e7-c1d893ae6f24 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:31.933839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3b181b7d-74a2-4da0-82e7-c1d893ae6f24 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:31.934261 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3b181b7d-74a2-4da0-82e7-c1d893ae6f24 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:32.168605 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3b181b7d-74a2-4da0-82e7-c1d893ae6f24 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250126 Aug 17 19:48:32.169204 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 435/875] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:48:31 2022] POST /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:48:43.907195 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9a37b11d-8954-4dda-b4e9-d429c34ad9d4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58917ffb-dda9-4a1e-b5bb-22308af75f8b"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:48:43.910185 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9a37b11d-8954-4dda-b4e9-d429c34ad9d4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:43.912602 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=24 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:43.913395 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=30 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:43.919413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9a37b11d-8954-4dda-b4e9-d429c34ad9d4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:43.919886 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9a37b11d-8954-4dda-b4e9-d429c34ad9d4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:43.920325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9a37b11d-8954-4dda-b4e9-d429c34ad9d4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:43.921022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9a37b11d-8954-4dda-b4e9-d429c34ad9d4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:43.921498 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9a37b11d-8954-4dda-b4e9-d429c34ad9d4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:43.921983 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9a37b11d-8954-4dda-b4e9-d429c34ad9d4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:43.999641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-9a37b11d-8954-4dda-b4e9-d429c34ad9d4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Invalid volume: volume 58917ffb-dda9-4a1e-b5bb-22308af75f8b is already attached to instances: b2abccd0-4628-4403-bab1-66eac1ca2712 Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9a37b11d-8954-4dda-b4e9-d429c34ad9d4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: POST /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-volume_attachments HTTP/1.1 Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 74 Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:48:44.001932 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:48:44.003523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:48:44.003523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:48:44.003523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:48:44.003523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:48:44.003523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:48:44.003523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:48:44.003523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:48:44.003523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:48:44.003523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:48:44.003523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Aug 17 19:48:44.003523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {"volumeAttachment": {"volumeId": "58917ffb-dda9-4a1e-b5bb-22308af75f8b"}} Aug 17 19:48:44.003523 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Invalid volume: volume 58917ffb-dda9-4a1e-b5bb-22308af75f8b is already attached to instances: b2abccd0-4628-4403-bab1-66eac1ca2712 Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'server_id': 'b2abccd0-4628-4403-bab1-66eac1ca2712', 'body': {'volumeAttachment': {'volumeId': '58917ffb-dda9-4a1e-b5bb-22308af75f8b'}}} Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 58917ffb-dda9-4a1e-b5bb-22308af75f8b is already attached to instances: b2abccd0-4628-4403-bab1-66eac1ca2712 Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:44.004413 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 58917ffb-dda9-4a1e-b5bb-22308af75f8b is already attached to instances: b2abccd0-4628-4403-bab1-66eac1ca2712 Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:48:44.005810 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:48:44.007054 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:48:44.007054 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:48:44.007054 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:48:44.007054 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 58917ffb-dda9-4a1e-b5bb-22308af75f8b is already attached to instances: b2abccd0-4628-4403-bab1-66eac1ca2712 Aug 17 19:48:44.007054 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:44.007054 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9a37b11d-8954-4dda-b4e9-d429c34ad9d4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 400 to user: Invalid volume: volume 58917ffb-dda9-4a1e-b5bb-22308af75f8b is already attached to instances: b2abccd0-4628-4403-bab1-66eac1ca2712 {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:48:44.007054 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9a37b11d-8954-4dda-b4e9-d429c34ad9d4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100196 Aug 17 19:48:44.007054 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 441/876] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:48:43 2022] POST /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 19:48:44.063402 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:44.064756 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:48:44.069139 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d302e629-0bfb-4845-ba00-8cbf9941010e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:44.069738 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d302e629-0bfb-4845-ba00-8cbf9941010e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:44.078138 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d302e629-0bfb-4845-ba00-8cbf9941010e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:44.078623 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d302e629-0bfb-4845-ba00-8cbf9941010e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:44.079053 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d302e629-0bfb-4845-ba00-8cbf9941010e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:44.080324 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d302e629-0bfb-4845-ba00-8cbf9941010e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:44.080774 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d302e629-0bfb-4845-ba00-8cbf9941010e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:44.081191 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d302e629-0bfb-4845-ba00-8cbf9941010e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:44.162650 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-d302e629-0bfb-4845-ba00-8cbf9941010e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lazy-loading 'services' on Instance uuid b2abccd0-4628-4403-bab1-66eac1ca2712 {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:48:44.238637 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d302e629-0bfb-4845-ba00-8cbf9941010e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-volume_attachments/58917ffb-dda9-4a1e-b5bb-22308af75f8b" status: 202 len: 0 microversion: 2.1 time: 0.176517 Aug 17 19:48:44.239311 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 436/877] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 17 19:48:44 2022] DELETE /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-volume_attachments/58917ffb-dda9-4a1e-b5bb-22308af75f8b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:48:44.248610 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-29d79b4f-3aef-405b-bdd3-a7d9827d749c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:44.250956 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-29d79b4f-3aef-405b-bdd3-a7d9827d749c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:44.261570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-29d79b4f-3aef-405b-bdd3-a7d9827d749c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:44.262308 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-29d79b4f-3aef-405b-bdd3-a7d9827d749c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:44.262746 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-29d79b4f-3aef-405b-bdd3-a7d9827d749c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:44.263451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-29d79b4f-3aef-405b-bdd3-a7d9827d749c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:44.263918 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-29d79b4f-3aef-405b-bdd3-a7d9827d749c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:44.264493 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-29d79b4f-3aef-405b-bdd3-a7d9827d749c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:44.295861 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-29d79b4f-3aef-405b-bdd3-a7d9827d749c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051390 Aug 17 19:48:44.296415 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 442/878] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:48:44 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:48:45.310156 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f548a958-6606-4118-b12e-75e1bd346635 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:45.312389 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f548a958-6606-4118-b12e-75e1bd346635 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:45.321729 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f548a958-6606-4118-b12e-75e1bd346635 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:45.322506 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f548a958-6606-4118-b12e-75e1bd346635 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:45.322715 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f548a958-6606-4118-b12e-75e1bd346635 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:45.323351 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f548a958-6606-4118-b12e-75e1bd346635 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:45.324020 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f548a958-6606-4118-b12e-75e1bd346635 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:45.324634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f548a958-6606-4118-b12e-75e1bd346635 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:45.354222 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f548a958-6606-4118-b12e-75e1bd346635 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048751 Aug 17 19:48:45.354778 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 437/879] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:48:45 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 19:48:45.415959 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5e6e1f75-dd26-4aba-b8fb-1f1b11a1a5b6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:45.416498 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5e6e1f75-dd26-4aba-b8fb-1f1b11a1a5b6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:45.423043 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5e6e1f75-dd26-4aba-b8fb-1f1b11a1a5b6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:45.423561 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5e6e1f75-dd26-4aba-b8fb-1f1b11a1a5b6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:45.424001 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5e6e1f75-dd26-4aba-b8fb-1f1b11a1a5b6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:45.424694 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5e6e1f75-dd26-4aba-b8fb-1f1b11a1a5b6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:45.425152 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5e6e1f75-dd26-4aba-b8fb-1f1b11a1a5b6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:45.425660 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5e6e1f75-dd26-4aba-b8fb-1f1b11a1a5b6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:45.452031 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5e6e1f75-dd26-4aba-b8fb-1f1b11a1a5b6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:48:45.526309 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5e6e1f75-dd26-4aba-b8fb-1f1b11a1a5b6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 204 len: 0 microversion: 2.1 time: 0.114071 Aug 17 19:48:45.527191 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 443/880] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:48:45 2022] DELETE /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:48:45.536791 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-cd16257d-b0ad-4524-8beb-81aa90c29c10 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:45.537442 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-cd16257d-b0ad-4524-8beb-81aa90c29c10 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:45.543253 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cd16257d-b0ad-4524-8beb-81aa90c29c10 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:45.543732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cd16257d-b0ad-4524-8beb-81aa90c29c10 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:45.544162 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cd16257d-b0ad-4524-8beb-81aa90c29c10 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:45.544839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cd16257d-b0ad-4524-8beb-81aa90c29c10 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:45.545321 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cd16257d-b0ad-4524-8beb-81aa90c29c10 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:45.545740 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cd16257d-b0ad-4524-8beb-81aa90c29c10 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:45.678036 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-cd16257d-b0ad-4524-8beb-81aa90c29c10 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:45.685467 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-cd16257d-b0ad-4524-8beb-81aa90c29c10 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 200 len: 1682 microversion: 2.1 time: 0.153681 Aug 17 19:48:45.686029 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 438/881] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:45 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:46.706960 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-46fb677b-ade6-4a94-9924-f1469edb9d59 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:46.707672 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-46fb677b-ade6-4a94-9924-f1469edb9d59 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:46.713971 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-46fb677b-ade6-4a94-9924-f1469edb9d59 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:46.714455 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-46fb677b-ade6-4a94-9924-f1469edb9d59 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:46.714893 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-46fb677b-ade6-4a94-9924-f1469edb9d59 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:46.715584 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-46fb677b-ade6-4a94-9924-f1469edb9d59 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:46.716043 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-46fb677b-ade6-4a94-9924-f1469edb9d59 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:46.716470 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-46fb677b-ade6-4a94-9924-f1469edb9d59 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:46.843017 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-46fb677b-ade6-4a94-9924-f1469edb9d59 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:46.850378 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-46fb677b-ade6-4a94-9924-f1469edb9d59 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 200 len: 1682 microversion: 2.1 time: 0.147676 Aug 17 19:48:46.850933 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 444/882] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:46 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:47.472149 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ef271aae-c01f-4f1d-a6a7-deb7e61e1fa2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:47.472650 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ef271aae-c01f-4f1d-a6a7-deb7e61e1fa2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:47.479040 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ef271aae-c01f-4f1d-a6a7-deb7e61e1fa2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:47.479528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ef271aae-c01f-4f1d-a6a7-deb7e61e1fa2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:47.479966 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ef271aae-c01f-4f1d-a6a7-deb7e61e1fa2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:47.480666 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ef271aae-c01f-4f1d-a6a7-deb7e61e1fa2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:47.481120 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ef271aae-c01f-4f1d-a6a7-deb7e61e1fa2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:47.481592 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ef271aae-c01f-4f1d-a6a7-deb7e61e1fa2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:47.562636 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-ef271aae-c01f-4f1d-a6a7-deb7e61e1fa2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lazy-loading 'services' on Instance uuid c92c812f-de25-4962-997a-1164f56cbdd1 {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:48:47.638934 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ef271aae-c01f-4f1d-a6a7-deb7e61e1fa2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1/os-volume_attachments/293a7b27-fa12-4258-a417-23956eda477b" status: 202 len: 0 microversion: 2.1 time: 0.171073 Aug 17 19:48:47.639630 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 439/883] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 17 19:48:47 2022] DELETE /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1/os-volume_attachments/293a7b27-fa12-4258-a417-23956eda477b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 19:48:47.871902 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-db519f47-7eb0-44d4-baaf-54e3608ff871 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:47.872499 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-db519f47-7eb0-44d4-baaf-54e3608ff871 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:47.879443 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-db519f47-7eb0-44d4-baaf-54e3608ff871 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:47.879930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-db519f47-7eb0-44d4-baaf-54e3608ff871 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:47.880361 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-db519f47-7eb0-44d4-baaf-54e3608ff871 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:47.881057 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-db519f47-7eb0-44d4-baaf-54e3608ff871 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:47.881536 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-db519f47-7eb0-44d4-baaf-54e3608ff871 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:47.881957 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-db519f47-7eb0-44d4-baaf-54e3608ff871 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:47.943770 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-db519f47-7eb0-44d4-baaf-54e3608ff871 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:47.951747 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-db519f47-7eb0-44d4-baaf-54e3608ff871 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 200 len: 1614 microversion: 2.1 time: 0.083737 Aug 17 19:48:47.952477 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 445/884] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:47 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:48.076541 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-36603060-1311-4da8-a94e-45f92418ece7 req-13323c82-1bcb-4dc1-a1bc-ee130d393765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2abccd0-4628-4403-bab1-66eac1ca2712", "name": "network-vif-deleted", "tag": "97c7dd3c-ccbc-4beb-ba5e-a1625fd4f1c0"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:48:48.090055 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-36603060-1311-4da8-a94e-45f92418ece7 req-13323c82-1bcb-4dc1-a1bc-ee130d393765 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:48.091159 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-36603060-1311-4da8-a94e-45f92418ece7 req-13323c82-1bcb-4dc1-a1bc-ee130d393765 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:48.091744 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-36603060-1311-4da8-a94e-45f92418ece7 req-13323c82-1bcb-4dc1-a1bc-ee130d393765 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:48.108719 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-36603060-1311-4da8-a94e-45f92418ece7 req-13323c82-1bcb-4dc1-a1bc-ee130d393765 service nova] Creating event network-vif-deleted:97c7dd3c-ccbc-4beb-ba5e-a1625fd4f1c0 for instance b2abccd0-4628-4403-bab1-66eac1ca2712 on hv-cinder-85069 Aug 17 19:48:48.121427 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-36603060-1311-4da8-a94e-45f92418ece7 req-13323c82-1bcb-4dc1-a1bc-ee130d393765 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049107 Aug 17 19:48:48.122650 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 440/885] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:48:48.767774 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0c9eea11-24ca-4c17-a3e7-7dee83337bf8 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:48.768276 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0c9eea11-24ca-4c17-a3e7-7dee83337bf8 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:48.774375 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0c9eea11-24ca-4c17-a3e7-7dee83337bf8 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:48.774852 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0c9eea11-24ca-4c17-a3e7-7dee83337bf8 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:48.775278 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0c9eea11-24ca-4c17-a3e7-7dee83337bf8 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:48.775955 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0c9eea11-24ca-4c17-a3e7-7dee83337bf8 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:48.776401 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0c9eea11-24ca-4c17-a3e7-7dee83337bf8 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:48.776819 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0c9eea11-24ca-4c17-a3e7-7dee83337bf8 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:48.801874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0c9eea11-24ca-4c17-a3e7-7dee83337bf8 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:48:48.881416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0c9eea11-24ca-4c17-a3e7-7dee83337bf8 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 204 len: 0 microversion: 2.1 time: 0.117734 Aug 17 19:48:48.882101 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 446/886] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:48:48 2022] DELETE /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:48:48.892547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-cc596eea-e6c8-452d-b7c4-30b2585f4918 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:48.893538 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-cc596eea-e6c8-452d-b7c4-30b2585f4918 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:48.900536 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc596eea-e6c8-452d-b7c4-30b2585f4918 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:48.901105 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc596eea-e6c8-452d-b7c4-30b2585f4918 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:48.901678 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc596eea-e6c8-452d-b7c4-30b2585f4918 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:48.902445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc596eea-e6c8-452d-b7c4-30b2585f4918 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:48.903103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc596eea-e6c8-452d-b7c4-30b2585f4918 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:48.903528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cc596eea-e6c8-452d-b7c4-30b2585f4918 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:48.974351 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-22aba9e7-7c80-40f5-b107-015d0932ba37 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:48.975067 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-22aba9e7-7c80-40f5-b107-015d0932ba37 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:48.981111 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-22aba9e7-7c80-40f5-b107-015d0932ba37 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:48.981631 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-22aba9e7-7c80-40f5-b107-015d0932ba37 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:48.982060 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-22aba9e7-7c80-40f5-b107-015d0932ba37 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:48.982752 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-22aba9e7-7c80-40f5-b107-015d0932ba37 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:48.983197 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-22aba9e7-7c80-40f5-b107-015d0932ba37 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:48.983773 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-22aba9e7-7c80-40f5-b107-015d0932ba37 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:49.000743 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-22aba9e7-7c80-40f5-b107-015d0932ba37 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-22aba9e7-7c80-40f5-b107-015d0932ba37 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 HTTP/1.1 Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:48:49.002996 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:48:49.004416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:48:49.004416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:48:49.004416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:48:49.004416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:48:49.004416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:48:49.004416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:48:49.004416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:48:49.004416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:48:49.004416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:48:49.004416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:48:49.004416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:48:49.004416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': 'b2abccd0-4628-4403-bab1-66eac1ca2712'} Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:48:49.005182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:48:49.006451 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:49.007625 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-22aba9e7-7c80-40f5-b107-015d0932ba37 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 404 to user: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:48:49.007625 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-22aba9e7-7c80-40f5-b107-015d0932ba37 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 404 len: 111 microversion: 2.1 time: 0.034497 Aug 17 19:48:49.007625 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 447/887] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:48 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:48:49.013624 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0ed3035e-2865-4077-b655-12b7302e40a4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '.version_select at 0x7f3689e36a60>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:49.033367 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0ed3035e-2865-4077-b655-12b7302e40a4 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-183738081" status: 202 len: 0 microversion: 2.1 time: 0.023722 Aug 17 19:48:49.033926 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 448/888] 10.222.0.59 () {58 vars in 1218 bytes} [Wed Aug 17 19:48:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-183738081 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:48:49.070320 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-cc596eea-e6c8-452d-b7c4-30b2585f4918 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:49.078376 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-cc596eea-e6c8-452d-b7c4-30b2585f4918 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1513 microversion: 2.1 time: 0.191073 Aug 17 19:48:49.079211 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 441/889] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:48 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:49.644842 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-6c1bb6e9-1744-492f-98e2-d71b65ae74a0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: .version_select at 0x7f368a0c0700>, body: {"keypair": {"name": "tempest-keypair-1578428112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiTS4ece4JZHSAdvqSFMEsiP7+HncTCSM6D9onOl56t0EKBSoT6Qkh+LzoqYHLMJvrQCxffzl9bOeYqxk9EzA/Sd4ECy9qSipKO8uyoFsNXjDhFfOOt8ryOCY/Dvx8ieg=="}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:48:49.660418 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-6c1bb6e9-1744-492f-98e2-d71b65ae74a0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for project d48524fb6ff040dcac98b23363268772. Resources: {'key_pairs'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:48:49.664209 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-6c1bb6e9-1744-492f-98e2-d71b65ae74a0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for user 22406c8108a4408aa39c5d174d032e20 and project d48524fb6ff040dcac98b23363268772. Resources: {'key_pairs'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:48:49.685052 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-6c1bb6e9-1744-492f-98e2-d71b65ae74a0 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044502 Aug 17 19:48:49.685636 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 449/890] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 17 19:48:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:48:50.100035 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1f21ca47-98e0-4eff-b0d8-2e703a7472c2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:50.100639 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1f21ca47-98e0-4eff-b0d8-2e703a7472c2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:50.106931 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1f21ca47-98e0-4eff-b0d8-2e703a7472c2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:50.107407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1f21ca47-98e0-4eff-b0d8-2e703a7472c2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:50.107833 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1f21ca47-98e0-4eff-b0d8-2e703a7472c2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:50.108514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1f21ca47-98e0-4eff-b0d8-2e703a7472c2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:50.108959 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1f21ca47-98e0-4eff-b0d8-2e703a7472c2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:50.109402 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1f21ca47-98e0-4eff-b0d8-2e703a7472c2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:50.240139 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1f21ca47-98e0-4eff-b0d8-2e703a7472c2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:50.247583 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1f21ca47-98e0-4eff-b0d8-2e703a7472c2 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1513 microversion: 2.1 time: 0.152165 Aug 17 19:48:50.248149 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 442/891] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:50 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:51.079658 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1285476119", "imageRef": "78154e55-d7d3-4ae2-a914-ab6dfbec86b5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04936ff2-1cb2-462b-9dfb-59deb589561c"}], "security_groups": [{"name": "tempest-securitygroup--1923144746"}], "key_name": "tempest-keypair-1578428112", "user_data": "}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:48:51.183067 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.network.neutron [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] validate_networks() for [('04936ff2-1cb2-462b-9dfb-59deb589561c', None, None, None, None, None)] {{(pid=132531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:48:51.243190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-54c1a1a0-e1a3-462e-9e04-2457a77bc777 req-2d9a6c0f-c2e6-4b09-9cf0-da2d4d668a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c92c812f-de25-4962-997a-1164f56cbdd1", "name": "network-vif-deleted", "tag": "8af61491-719f-4cef-8c81-99a8aa08ac1e"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:48:51.255711 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-54c1a1a0-e1a3-462e-9e04-2457a77bc777 req-2d9a6c0f-c2e6-4b09-9cf0-da2d4d668a17 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:51.256202 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-54c1a1a0-e1a3-462e-9e04-2457a77bc777 req-2d9a6c0f-c2e6-4b09-9cf0-da2d4d668a17 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:51.256636 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-54c1a1a0-e1a3-462e-9e04-2457a77bc777 req-2d9a6c0f-c2e6-4b09-9cf0-da2d4d668a17 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:51.268533 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-54c1a1a0-e1a3-462e-9e04-2457a77bc777 req-2d9a6c0f-c2e6-4b09-9cf0-da2d4d668a17 service nova] Creating event network-vif-deleted:8af61491-719f-4cef-8c81-99a8aa08ac1e for instance c92c812f-de25-4962-997a-1164f56cbdd1 on hv-cinder-85069 Aug 17 19:48:51.274442 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-54c1a1a0-e1a3-462e-9e04-2457a77bc777 req-2d9a6c0f-c2e6-4b09-9cf0-da2d4d668a17 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035172 Aug 17 19:48:51.275270 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 443/892] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:48:51.282890 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c54e3ab6-d7de-431a-aed2-335d9d7a0a59 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:51.283657 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c54e3ab6-d7de-431a-aed2-335d9d7a0a59 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:51.289974 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c54e3ab6-d7de-431a-aed2-335d9d7a0a59 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:51.290464 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c54e3ab6-d7de-431a-aed2-335d9d7a0a59 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:51.290908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c54e3ab6-d7de-431a-aed2-335d9d7a0a59 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:51.291785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c54e3ab6-d7de-431a-aed2-335d9d7a0a59 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:51.292253 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c54e3ab6-d7de-431a-aed2-335d9d7a0a59 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:51.292681 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c54e3ab6-d7de-431a-aed2-335d9d7a0a59 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:51.359713 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c54e3ab6-d7de-431a-aed2-335d9d7a0a59 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285afd956888457d9cd947713e6826ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1bc20a6ee5c4e61ab2f8b0683543ddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:51.371167 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c54e3ab6-d7de-431a-aed2-335d9d7a0a59 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 200 len: 1303 microversion: 2.1 time: 0.092468 Aug 17 19:48:51.371811 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 444/893] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:51 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:51.594533 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Flavor limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:48:51.594963 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Image limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:48:51.595949 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Flavor pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:48:51.596360 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Image pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:48:51.596768 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:48:51.605658 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:51.606138 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:51.606576 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:51.607300 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:51.607756 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:51.608182 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:51.626293 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for project d48524fb6ff040dcac98b23363268772. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:48:51.630600 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Getting quotas for user 22406c8108a4408aa39c5d174d032e20 and project d48524fb6ff040dcac98b23363268772. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:48:51.641779 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Going to run 1 instances... {{(pid=132531) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:48:51.644063 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78154e55-d7d3-4ae2-a914-ab6dfbec86b5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:48:51.693715 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-4e3c7bda-086e-48f8-96bc-30bed2d21d17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.618701 Aug 17 19:48:51.694368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 450/894] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:48:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:48:51.706397 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-75438bed-b4e3-44b5-bfc3-3606ef426399 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:51.707337 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-75438bed-b4e3-44b5-bfc3-3606ef426399 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:51.765121 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-75438bed-b4e3-44b5-bfc3-3606ef426399 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:51.772335 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-75438bed-b4e3-44b5-bfc3-3606ef426399 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1242 microversion: 2.1 time: 0.070397 Aug 17 19:48:51.772892 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 445/895] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:51 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:52.393784 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5ffa8d0e-1d9c-44fb-9651-c360a70f1fd0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:52.394398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5ffa8d0e-1d9c-44fb-9651-c360a70f1fd0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] [instance: c92c812f-de25-4962-997a-1164f56cbdd1] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:52.400396 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ffa8d0e-1d9c-44fb-9651-c360a70f1fd0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:52.400886 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ffa8d0e-1d9c-44fb-9651-c360a70f1fd0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:52.401353 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ffa8d0e-1d9c-44fb-9651-c360a70f1fd0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:52.402044 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ffa8d0e-1d9c-44fb-9651-c360a70f1fd0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:52.402500 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ffa8d0e-1d9c-44fb-9651-c360a70f1fd0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:52.402924 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5ffa8d0e-1d9c-44fb-9651-c360a70f1fd0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:52.416606 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-5ffa8d0e-1d9c-44fb-9651-c360a70f1fd0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] HTTP exception thrown: Instance c92c812f-de25-4962-997a-1164f56cbdd1 could not be found. Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5ffa8d0e-1d9c-44fb-9651-c360a70f1fd0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Request method failure captured: Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 HTTP/1.1 Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UXELUMHGc3h2XjMb6zgEBqp84D4n0iC97S-0wd2PA-GWwDLYja4vc_U1adC6nm4SsB8WwImRLnzVwITmnYvasu6VkJULrY44A648a0fslFnqpR1cIO89P9Uj5JPZ0Cugf_q_cP8mnGqIrUwJh4mSncYtvZ0d1gvV3irfxI3GJqEDJ0 Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: e1bc20a6ee5c4e61ab2f8b0683543ddc Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1991522373 Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:48:52.418118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:48:52.419744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e1bc20a6ee5c4e61ab2f8b0683543ddc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1bc20a6ee5c4e61ab2f8b0683543ddc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e1bc20a6ee5c4e61ab2f8b0683543ddc", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e1bc20a6ee5c4e61ab2f8b0683543ddc"}]}] Aug 17 19:48:52.419744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-VolumesSnapshotTestJSON-1991522373 Aug 17 19:48:52.419744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: e1bc20a6ee5c4e61ab2f8b0683543ddc Aug 17 19:48:52.419744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1991522373 Aug 17 19:48:52.419744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-VolumesSnapshotTestJSON-1991522373-project Aug 17 19:48:52.419744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:48:52.419744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:48:52.419744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 285afd956888457d9cd947713e6826ac Aug 17 19:48:52.419744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-VolumesSnapshotTestJSON-1991522373-project Aug 17 19:48:52.419744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:48:52.419744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance c92c812f-de25-4962-997a-1164f56cbdd1 could not be found. Aug 17 19:48:52.419744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': 'c92c812f-de25-4962-997a-1164f56cbdd1'} Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c92c812f-de25-4962-997a-1164f56cbdd1 could not be found. Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:48:52.420599 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c92c812f-de25-4962-997a-1164f56cbdd1 could not be found. Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c92c812f-de25-4962-997a-1164f56cbdd1 could not be found. Aug 17 19:48:52.422032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:48:52.423928 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5ffa8d0e-1d9c-44fb-9651-c360a70f1fd0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] Returning 404 to user: Instance c92c812f-de25-4962-997a-1164f56cbdd1 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:48:52.423928 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5ffa8d0e-1d9c-44fb-9651-c360a70f1fd0 tempest-VolumesSnapshotTestJSON-1991522373 tempest-VolumesSnapshotTestJSON-1991522373-project] 10.222.0.59 "GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1" status: 404 len: 111 microversion: 2.1 time: 0.030260 Aug 17 19:48:52.423928 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 451/896] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:52 2022] GET /compute/v2.1/servers/c92c812f-de25-4962-997a-1164f56cbdd1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:48:52.792549 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-cf3efd5e-b234-4139-98b4-e71f304d9047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:52.793177 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-cf3efd5e-b234-4139-98b4-e71f304d9047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:52.801742 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cf3efd5e-b234-4139-98b4-e71f304d9047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:52.802221 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cf3efd5e-b234-4139-98b4-e71f304d9047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:52.802655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cf3efd5e-b234-4139-98b4-e71f304d9047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:52.803337 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cf3efd5e-b234-4139-98b4-e71f304d9047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:52.803787 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cf3efd5e-b234-4139-98b4-e71f304d9047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:52.804207 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-cf3efd5e-b234-4139-98b4-e71f304d9047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:53.018372 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-cf3efd5e-b234-4139-98b4-e71f304d9047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:53.025864 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-cf3efd5e-b234-4139-98b4-e71f304d9047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1300 microversion: 2.1 time: 0.237121 Aug 17 19:48:53.026734 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 446/897] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:52 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1300 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:54.047512 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-67ffccd1-7716-4e23-8714-d51031d59b34 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:54.048122 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-67ffccd1-7716-4e23-8714-d51031d59b34 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:54.055068 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-67ffccd1-7716-4e23-8714-d51031d59b34 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:54.055547 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-67ffccd1-7716-4e23-8714-d51031d59b34 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:54.055979 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-67ffccd1-7716-4e23-8714-d51031d59b34 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:54.056827 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-67ffccd1-7716-4e23-8714-d51031d59b34 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:54.057307 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-67ffccd1-7716-4e23-8714-d51031d59b34 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:54.057730 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-67ffccd1-7716-4e23-8714-d51031d59b34 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:54.190463 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-67ffccd1-7716-4e23-8714-d51031d59b34 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:54.198267 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-67ffccd1-7716-4e23-8714-d51031d59b34 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1368 microversion: 2.1 time: 0.154845 Aug 17 19:48:54.199093 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 452/898] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:54 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:54.207249 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-95d0dbb8-26a8-4af5-9ec5-58868684a940 req-49a8c74f-0bff-49d2-b372-45093e8ff73f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833ddab4-258d-4891-bad4-8401df08a3e0", "tag": "fb04004f-1f4c-4907-8d1d-6f87822616e7"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:48:54.217778 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-95d0dbb8-26a8-4af5-9ec5-58868684a940 req-49a8c74f-0bff-49d2-b372-45093e8ff73f service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:54.218364 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-95d0dbb8-26a8-4af5-9ec5-58868684a940 req-49a8c74f-0bff-49d2-b372-45093e8ff73f service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:54.218875 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-95d0dbb8-26a8-4af5-9ec5-58868684a940 req-49a8c74f-0bff-49d2-b372-45093e8ff73f service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:54.229923 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-95d0dbb8-26a8-4af5-9ec5-58868684a940 req-49a8c74f-0bff-49d2-b372-45093e8ff73f service nova] Creating event network-changed:fb04004f-1f4c-4907-8d1d-6f87822616e7 for instance 833ddab4-258d-4891-bad4-8401df08a3e0 on hv-cinder-85069 Aug 17 19:48:54.234757 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-95d0dbb8-26a8-4af5-9ec5-58868684a940 req-49a8c74f-0bff-49d2-b372-45093e8ff73f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031424 Aug 17 19:48:54.235334 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 447/899] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:48:55.218977 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1c97f8e4-6b11-4eba-9500-d11fbe50775a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:55.219582 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1c97f8e4-6b11-4eba-9500-d11fbe50775a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:55.226058 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c97f8e4-6b11-4eba-9500-d11fbe50775a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:55.226541 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c97f8e4-6b11-4eba-9500-d11fbe50775a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:55.226977 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c97f8e4-6b11-4eba-9500-d11fbe50775a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:55.227664 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c97f8e4-6b11-4eba-9500-d11fbe50775a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:55.228118 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c97f8e4-6b11-4eba-9500-d11fbe50775a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:55.228542 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1c97f8e4-6b11-4eba-9500-d11fbe50775a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:55.354724 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1c97f8e4-6b11-4eba-9500-d11fbe50775a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:55.362499 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1c97f8e4-6b11-4eba-9500-d11fbe50775a tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1368 microversion: 2.1 time: 0.147440 Aug 17 19:48:55.363057 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 453/900] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:55 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:56.386332 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-473f453d-2eaf-4e79-a029-2991b6c2e60d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:56.387063 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-473f453d-2eaf-4e79-a029-2991b6c2e60d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:56.393745 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-473f453d-2eaf-4e79-a029-2991b6c2e60d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:56.394227 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-473f453d-2eaf-4e79-a029-2991b6c2e60d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:56.394662 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-473f453d-2eaf-4e79-a029-2991b6c2e60d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:56.395349 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-473f453d-2eaf-4e79-a029-2991b6c2e60d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:56.395801 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-473f453d-2eaf-4e79-a029-2991b6c2e60d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:56.396225 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-473f453d-2eaf-4e79-a029-2991b6c2e60d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:56.665827 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-473f453d-2eaf-4e79-a029-2991b6c2e60d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:56.673613 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-473f453d-2eaf-4e79-a029-2991b6c2e60d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1368 microversion: 2.1 time: 0.291836 Aug 17 19:48:56.674370 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 448/901] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:56 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1368 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:57.694330 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e7494c11-bd7b-4c91-a26a-91dd004ceba7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:57.694954 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e7494c11-bd7b-4c91-a26a-91dd004ceba7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:57.701727 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e7494c11-bd7b-4c91-a26a-91dd004ceba7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:57.702221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e7494c11-bd7b-4c91-a26a-91dd004ceba7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:57.702642 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e7494c11-bd7b-4c91-a26a-91dd004ceba7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:57.703334 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e7494c11-bd7b-4c91-a26a-91dd004ceba7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:57.703792 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e7494c11-bd7b-4c91-a26a-91dd004ceba7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:57.704218 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e7494c11-bd7b-4c91-a26a-91dd004ceba7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:57.884386 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e7494c11-bd7b-4c91-a26a-91dd004ceba7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:57.891744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e7494c11-bd7b-4c91-a26a-91dd004ceba7 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1368 microversion: 2.1 time: 0.201334 Aug 17 19:48:57.892812 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 454/902] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:57 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:48:58.912480 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-76a0bf15-22a5-47f4-9145-247947cc9c17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:48:58.913097 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-76a0bf15-22a5-47f4-9145-247947cc9c17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:48:58.919728 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76a0bf15-22a5-47f4-9145-247947cc9c17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:58.920216 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76a0bf15-22a5-47f4-9145-247947cc9c17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:58.920691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76a0bf15-22a5-47f4-9145-247947cc9c17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:58.921449 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76a0bf15-22a5-47f4-9145-247947cc9c17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:48:58.921931 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76a0bf15-22a5-47f4-9145-247947cc9c17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:48:58.922845 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-76a0bf15-22a5-47f4-9145-247947cc9c17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:48:59.047733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-76a0bf15-22a5-47f4-9145-247947cc9c17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:48:59.055072 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-76a0bf15-22a5-47f4-9145-247947cc9c17 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1368 microversion: 2.1 time: 0.146525 Aug 17 19:48:59.055627 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 449/903] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:48:58 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:49:00.076170 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-012dd831-73cc-4c9b-9ce7-32cfd8d63dbd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:00.076788 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-012dd831-73cc-4c9b-9ce7-32cfd8d63dbd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:00.083820 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-012dd831-73cc-4c9b-9ce7-32cfd8d63dbd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:00.084246 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-012dd831-73cc-4c9b-9ce7-32cfd8d63dbd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:00.084684 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-012dd831-73cc-4c9b-9ce7-32cfd8d63dbd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:00.085427 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-012dd831-73cc-4c9b-9ce7-32cfd8d63dbd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:00.085885 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-012dd831-73cc-4c9b-9ce7-32cfd8d63dbd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:00.086309 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-012dd831-73cc-4c9b-9ce7-32cfd8d63dbd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:00.218608 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-012dd831-73cc-4c9b-9ce7-32cfd8d63dbd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:49:00.226732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-012dd831-73cc-4c9b-9ce7-32cfd8d63dbd tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1368 microversion: 2.1 time: 0.154737 Aug 17 19:49:00.227286 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 455/904] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:00 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:49:01.246701 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-70886e74-ca27-4d7c-beb5-0818afa513be tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:01.247315 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-70886e74-ca27-4d7c-beb5-0818afa513be tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:01.253657 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-70886e74-ca27-4d7c-beb5-0818afa513be tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:01.254139 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-70886e74-ca27-4d7c-beb5-0818afa513be tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:01.254576 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-70886e74-ca27-4d7c-beb5-0818afa513be tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:01.255262 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-70886e74-ca27-4d7c-beb5-0818afa513be tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:01.255714 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-70886e74-ca27-4d7c-beb5-0818afa513be tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:01.256137 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-70886e74-ca27-4d7c-beb5-0818afa513be tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:01.379663 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-70886e74-ca27-4d7c-beb5-0818afa513be tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:49:01.387016 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-70886e74-ca27-4d7c-beb5-0818afa513be tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1368 microversion: 2.1 time: 0.144161 Aug 17 19:49:01.387573 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 450/905] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:01 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1368 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:49:02.407914 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9fb4e965-8c7a-486e-a63c-18b06d0d0cef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:02.408521 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9fb4e965-8c7a-486e-a63c-18b06d0d0cef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:02.410988 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:49:02.411642 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=10 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:49:02.417184 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fb4e965-8c7a-486e-a63c-18b06d0d0cef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:02.417686 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fb4e965-8c7a-486e-a63c-18b06d0d0cef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:02.418112 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fb4e965-8c7a-486e-a63c-18b06d0d0cef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:02.418796 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fb4e965-8c7a-486e-a63c-18b06d0d0cef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:02.419242 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fb4e965-8c7a-486e-a63c-18b06d0d0cef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:02.419659 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9fb4e965-8c7a-486e-a63c-18b06d0d0cef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:02.546068 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9fb4e965-8c7a-486e-a63c-18b06d0d0cef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:49:02.553955 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9fb4e965-8c7a-486e-a63c-18b06d0d0cef tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1368 microversion: 2.1 time: 0.149953 Aug 17 19:49:02.554515 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 456/906] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:02 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:49:03.161978 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-56ca8c29-fbfc-4c27-bc43-60fd8ec5dc83 req-e3c12bc3-afab-453a-b72c-349c7c529a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833ddab4-258d-4891-bad4-8401df08a3e0", "name": "network-vif-plugged", "status": "completed", "tag": "fb04004f-1f4c-4907-8d1d-6f87822616e7"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:49:03.166774 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:49:03.174059 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-56ca8c29-fbfc-4c27-bc43-60fd8ec5dc83 req-e3c12bc3-afab-453a-b72c-349c7c529a9b service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:03.174559 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-56ca8c29-fbfc-4c27-bc43-60fd8ec5dc83 req-e3c12bc3-afab-453a-b72c-349c7c529a9b service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:03.174987 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-56ca8c29-fbfc-4c27-bc43-60fd8ec5dc83 req-e3c12bc3-afab-453a-b72c-349c7c529a9b service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:03.185798 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-56ca8c29-fbfc-4c27-bc43-60fd8ec5dc83 req-e3c12bc3-afab-453a-b72c-349c7c529a9b service nova] Creating event network-vif-plugged:fb04004f-1f4c-4907-8d1d-6f87822616e7 for instance 833ddab4-258d-4891-bad4-8401df08a3e0 on hv-cinder-85069 Aug 17 19:49:03.190682 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-56ca8c29-fbfc-4c27-bc43-60fd8ec5dc83 req-e3c12bc3-afab-453a-b72c-349c7c529a9b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032998 Aug 17 19:49:03.191448 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 451/907] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:49:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:49:03.575432 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9e5aae7b-6216-4990-ab3a-9ca05fbe4e04 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:03.576051 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9e5aae7b-6216-4990-ab3a-9ca05fbe4e04 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:03.582397 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9e5aae7b-6216-4990-ab3a-9ca05fbe4e04 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:03.582880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9e5aae7b-6216-4990-ab3a-9ca05fbe4e04 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:03.583492 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9e5aae7b-6216-4990-ab3a-9ca05fbe4e04 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:03.584179 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9e5aae7b-6216-4990-ab3a-9ca05fbe4e04 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:03.584636 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9e5aae7b-6216-4990-ab3a-9ca05fbe4e04 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:03.585061 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9e5aae7b-6216-4990-ab3a-9ca05fbe4e04 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:03.714136 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9e5aae7b-6216-4990-ab3a-9ca05fbe4e04 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:49:03.722445 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9e5aae7b-6216-4990-ab3a-9ca05fbe4e04 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1368 microversion: 2.1 time: 0.151354 Aug 17 19:49:03.722998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 457/908] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:03 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:49:04.744098 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ab7040e2-38b7-48d2-b0a6-3cc2b635b90c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:04.744721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ab7040e2-38b7-48d2-b0a6-3cc2b635b90c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:04.750794 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab7040e2-38b7-48d2-b0a6-3cc2b635b90c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:04.751908 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab7040e2-38b7-48d2-b0a6-3cc2b635b90c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:04.752346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab7040e2-38b7-48d2-b0a6-3cc2b635b90c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:04.753036 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab7040e2-38b7-48d2-b0a6-3cc2b635b90c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:04.753514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab7040e2-38b7-48d2-b0a6-3cc2b635b90c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:04.753937 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ab7040e2-38b7-48d2-b0a6-3cc2b635b90c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:04.883183 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ab7040e2-38b7-48d2-b0a6-3cc2b635b90c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:49:04.890673 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ab7040e2-38b7-48d2-b0a6-3cc2b635b90c tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1368 microversion: 2.1 time: 0.151425 Aug 17 19:49:04.891252 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 452/909] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:04 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:49:05.912175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-8e03f231-fe3c-482e-bfee-1c6d075403af tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:05.912781 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-8e03f231-fe3c-482e-bfee-1c6d075403af tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:05.919260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8e03f231-fe3c-482e-bfee-1c6d075403af tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:05.919740 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8e03f231-fe3c-482e-bfee-1c6d075403af tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:05.920167 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8e03f231-fe3c-482e-bfee-1c6d075403af tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:05.920852 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8e03f231-fe3c-482e-bfee-1c6d075403af tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:05.921333 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8e03f231-fe3c-482e-bfee-1c6d075403af tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:05.921752 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-8e03f231-fe3c-482e-bfee-1c6d075403af tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:05.926484 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:49:06.055817 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-8e03f231-fe3c-482e-bfee-1c6d075403af tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:49:06.063602 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-8e03f231-fe3c-482e-bfee-1c6d075403af tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1558 microversion: 2.1 time: 0.155767 Aug 17 19:49:06.064160 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 458/910] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:05 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:49:06.084435 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-17fee708-fdb3-4fe1-85b7-c63013d013d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:06.084983 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-17fee708-fdb3-4fe1-85b7-c63013d013d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:06.091231 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-17fee708-fdb3-4fe1-85b7-c63013d013d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:06.091718 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-17fee708-fdb3-4fe1-85b7-c63013d013d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:06.092160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-17fee708-fdb3-4fe1-85b7-c63013d013d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:06.092858 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-17fee708-fdb3-4fe1-85b7-c63013d013d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:06.093356 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-17fee708-fdb3-4fe1-85b7-c63013d013d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:06.093792 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-17fee708-fdb3-4fe1-85b7-c63013d013d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:06.173171 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-17fee708-fdb3-4fe1-85b7-c63013d013d6 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093051 Aug 17 19:49:06.173808 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 453/911] 10.222.0.59 () {58 vars in 1275 bytes} [Wed Aug 17 19:49:06 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:49:07.101071 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-98b845e3-9291-4b09-9764-a1e14f46bd1e req-5240fe40-7698-41f1-87fb-0976889319f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "833ddab4-258d-4891-bad4-8401df08a3e0", "tag": "fb04004f-1f4c-4907-8d1d-6f87822616e7"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:49:07.112205 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-98b845e3-9291-4b09-9764-a1e14f46bd1e req-5240fe40-7698-41f1-87fb-0976889319f2 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:07.112732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-98b845e3-9291-4b09-9764-a1e14f46bd1e req-5240fe40-7698-41f1-87fb-0976889319f2 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:07.113143 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-98b845e3-9291-4b09-9764-a1e14f46bd1e req-5240fe40-7698-41f1-87fb-0976889319f2 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:07.124174 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-98b845e3-9291-4b09-9764-a1e14f46bd1e req-5240fe40-7698-41f1-87fb-0976889319f2 service nova] Creating event network-changed:fb04004f-1f4c-4907-8d1d-6f87822616e7 for instance 833ddab4-258d-4891-bad4-8401df08a3e0 on hv-cinder-85069 Aug 17 19:49:07.130124 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-98b845e3-9291-4b09-9764-a1e14f46bd1e req-5240fe40-7698-41f1-87fb-0976889319f2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032603 Aug 17 19:49:07.130629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 459/912] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:49:43.255981 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=38 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:49:43.256674 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:49:43.260529 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f201b206-f6bf-45ab-8af7-e001999ecff9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:43.261026 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f201b206-f6bf-45ab-8af7-e001999ecff9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:43.268119 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f201b206-f6bf-45ab-8af7-e001999ecff9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:43.269113 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f201b206-f6bf-45ab-8af7-e001999ecff9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:43.269653 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f201b206-f6bf-45ab-8af7-e001999ecff9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:43.270346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f201b206-f6bf-45ab-8af7-e001999ecff9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:43.270803 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f201b206-f6bf-45ab-8af7-e001999ecff9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:43.271233 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f201b206-f6bf-45ab-8af7-e001999ecff9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:43.293958 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f201b206-f6bf-45ab-8af7-e001999ecff9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0/ips" status: 200 len: 150 microversion: 2.1 time: 0.039683 Aug 17 19:49:43.294512 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 454/913] 10.222.0.59 () {58 vars in 1248 bytes} [Wed Aug 17 19:49:43 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:49:44.614312 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:49:44.615054 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=6 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:49:44.619732 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-f7481e92-efed-4181-acfd-942efff947b9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4475e895-87e4-4cc8-a377-d804026bdbcd"}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:49:44.622191 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-f7481e92-efed-4181-acfd-942efff947b9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:44.630022 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f7481e92-efed-4181-acfd-942efff947b9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:44.630506 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f7481e92-efed-4181-acfd-942efff947b9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:44.630942 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f7481e92-efed-4181-acfd-942efff947b9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:44.631623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f7481e92-efed-4181-acfd-942efff947b9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:44.632077 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f7481e92-efed-4181-acfd-942efff947b9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:44.632495 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-f7481e92-efed-4181-acfd-942efff947b9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:44.865234 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-f7481e92-efed-4181-acfd-942efff947b9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "POST /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252297 Aug 17 19:49:44.865857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 460/914] 10.222.0.59 () {60 vars in 1323 bytes} [Wed Aug 17 19:49:44 2022] POST /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:49:51.418366 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-44cbf7e7-b546-4999-b63c-50fc0e6a8b88 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:51.418904 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-44cbf7e7-b546-4999-b63c-50fc0e6a8b88 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:51.425716 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-44cbf7e7-b546-4999-b63c-50fc0e6a8b88 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:51.426205 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-44cbf7e7-b546-4999-b63c-50fc0e6a8b88 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:51.426646 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-44cbf7e7-b546-4999-b63c-50fc0e6a8b88 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:51.427350 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-44cbf7e7-b546-4999-b63c-50fc0e6a8b88 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:51.427812 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-44cbf7e7-b546-4999-b63c-50fc0e6a8b88 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:51.428237 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-44cbf7e7-b546-4999-b63c-50fc0e6a8b88 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:51.506483 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.objects.instance [None req-44cbf7e7-b546-4999-b63c-50fc0e6a8b88 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lazy-loading 'services' on Instance uuid 833ddab4-258d-4891-bad4-8401df08a3e0 {{(pid=132530) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:49:51.577755 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-44cbf7e7-b546-4999-b63c-50fc0e6a8b88 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0/os-volume_attachments/4475e895-87e4-4cc8-a377-d804026bdbcd" status: 202 len: 0 microversion: 2.1 time: 0.163047 Aug 17 19:49:51.578328 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 455/915] 10.222.0.59 () {58 vars in 1416 bytes} [Wed Aug 17 19:49:51 2022] DELETE /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0/os-volume_attachments/4475e895-87e4-4cc8-a377-d804026bdbcd => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:49:51.588568 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e94587e7-744e-4518-bc50-555fbfa7a3f8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:51.591074 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e94587e7-744e-4518-bc50-555fbfa7a3f8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:51.599026 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e94587e7-744e-4518-bc50-555fbfa7a3f8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:51.599612 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e94587e7-744e-4518-bc50-555fbfa7a3f8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:51.600085 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e94587e7-744e-4518-bc50-555fbfa7a3f8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:51.600791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e94587e7-744e-4518-bc50-555fbfa7a3f8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:51.601275 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e94587e7-744e-4518-bc50-555fbfa7a3f8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:51.601706 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e94587e7-744e-4518-bc50-555fbfa7a3f8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:51.633436 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e94587e7-744e-4518-bc50-555fbfa7a3f8 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049841 Aug 17 19:49:51.633990 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 461/916] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:49:51 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:49:52.646814 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d4d8edd6-3318-43fe-bdcf-deebeae01047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:52.649158 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d4d8edd6-3318-43fe-bdcf-deebeae01047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:52.655356 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d4d8edd6-3318-43fe-bdcf-deebeae01047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:52.655836 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d4d8edd6-3318-43fe-bdcf-deebeae01047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:52.656306 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d4d8edd6-3318-43fe-bdcf-deebeae01047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:52.657026 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d4d8edd6-3318-43fe-bdcf-deebeae01047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:52.657513 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d4d8edd6-3318-43fe-bdcf-deebeae01047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:52.657946 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d4d8edd6-3318-43fe-bdcf-deebeae01047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:52.685825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d4d8edd6-3318-43fe-bdcf-deebeae01047 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043849 Aug 17 19:49:52.686372 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 456/917] 10.222.0.59 () {58 vars in 1302 bytes} [Wed Aug 17 19:49:52 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 19:49:52.746835 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-86b44db9-c75d-4a87-880f-d385a579e89d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:52.747450 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-86b44db9-c75d-4a87-880f-d385a579e89d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:52.753794 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86b44db9-c75d-4a87-880f-d385a579e89d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:52.754274 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86b44db9-c75d-4a87-880f-d385a579e89d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:52.754709 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86b44db9-c75d-4a87-880f-d385a579e89d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:52.755390 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86b44db9-c75d-4a87-880f-d385a579e89d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:52.755840 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86b44db9-c75d-4a87-880f-d385a579e89d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:52.756260 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-86b44db9-c75d-4a87-880f-d385a579e89d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:52.788035 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-86b44db9-c75d-4a87-880f-d385a579e89d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:49:52.864131 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-86b44db9-c75d-4a87-880f-d385a579e89d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 204 len: 0 microversion: 2.1 time: 0.120847 Aug 17 19:49:52.864780 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 462/918] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:49:52 2022] DELETE /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:49:52.877829 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2bd1c5a0-9816-4ddf-9337-50f474779433 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:52.878666 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2bd1c5a0-9816-4ddf-9337-50f474779433 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:52.884671 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2bd1c5a0-9816-4ddf-9337-50f474779433 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:52.885158 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2bd1c5a0-9816-4ddf-9337-50f474779433 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:52.885642 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2bd1c5a0-9816-4ddf-9337-50f474779433 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:52.886335 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2bd1c5a0-9816-4ddf-9337-50f474779433 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:52.886792 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2bd1c5a0-9816-4ddf-9337-50f474779433 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:52.887220 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2bd1c5a0-9816-4ddf-9337-50f474779433 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:53.017240 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-2bd1c5a0-9816-4ddf-9337-50f474779433 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:49:53.025407 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2bd1c5a0-9816-4ddf-9337-50f474779433 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1683 microversion: 2.1 time: 0.155614 Aug 17 19:49:53.025971 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 457/919] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:52 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:49:54.047020 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3d6fd6a4-798d-47d7-80b9-363984509430 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:54.047652 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3d6fd6a4-798d-47d7-80b9-363984509430 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:54.054238 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3d6fd6a4-798d-47d7-80b9-363984509430 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:54.054718 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3d6fd6a4-798d-47d7-80b9-363984509430 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:54.055149 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3d6fd6a4-798d-47d7-80b9-363984509430 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:54.055831 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3d6fd6a4-798d-47d7-80b9-363984509430 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:54.056280 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3d6fd6a4-798d-47d7-80b9-363984509430 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:54.056699 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3d6fd6a4-798d-47d7-80b9-363984509430 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:54.184607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3d6fd6a4-798d-47d7-80b9-363984509430 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:49:54.192196 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3d6fd6a4-798d-47d7-80b9-363984509430 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1683 microversion: 2.1 time: 0.149461 Aug 17 19:49:54.192754 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 463/920] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:54 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:49:55.207090 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-be4a868d-b190-404f-93b5-d8a27cf05bb0 req-42e95819-bbf5-49cb-b1ae-f82a65dac89f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "833ddab4-258d-4891-bad4-8401df08a3e0", "name": "network-vif-deleted", "tag": "fb04004f-1f4c-4907-8d1d-6f87822616e7"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:49:55.214893 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-dff2e1ed-92dc-4609-8df6-49d4ff69c0e9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:55.215522 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-dff2e1ed-92dc-4609-8df6-49d4ff69c0e9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:55.217630 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-be4a868d-b190-404f-93b5-d8a27cf05bb0 req-42e95819-bbf5-49cb-b1ae-f82a65dac89f service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:55.218743 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-be4a868d-b190-404f-93b5-d8a27cf05bb0 req-42e95819-bbf5-49cb-b1ae-f82a65dac89f service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:55.218743 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-be4a868d-b190-404f-93b5-d8a27cf05bb0 req-42e95819-bbf5-49cb-b1ae-f82a65dac89f service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:55.225603 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dff2e1ed-92dc-4609-8df6-49d4ff69c0e9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:55.226102 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dff2e1ed-92dc-4609-8df6-49d4ff69c0e9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:55.226549 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dff2e1ed-92dc-4609-8df6-49d4ff69c0e9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:55.227445 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dff2e1ed-92dc-4609-8df6-49d4ff69c0e9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:55.227897 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dff2e1ed-92dc-4609-8df6-49d4ff69c0e9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:55.228690 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-dff2e1ed-92dc-4609-8df6-49d4ff69c0e9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:55.231850 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-be4a868d-b190-404f-93b5-d8a27cf05bb0 req-42e95819-bbf5-49cb-b1ae-f82a65dac89f service nova] Creating event network-vif-deleted:fb04004f-1f4c-4907-8d1d-6f87822616e7 for instance 833ddab4-258d-4891-bad4-8401df08a3e0 on hv-cinder-85069 Aug 17 19:49:55.237144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-be4a868d-b190-404f-93b5-d8a27cf05bb0 req-42e95819-bbf5-49cb-b1ae-f82a65dac89f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034213 Aug 17 19:49:55.238012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 458/921] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:49:55.297035 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-dff2e1ed-92dc-4609-8df6-49d4ff69c0e9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22406c8108a4408aa39c5d174d032e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48524fb6ff040dcac98b23363268772', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:49:55.307121 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-dff2e1ed-92dc-4609-8df6-49d4ff69c0e9 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 200 len: 1615 microversion: 2.1 time: 0.096617 Aug 17 19:49:55.308115 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 464/922] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:55 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 1615 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:49:56.330152 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ec8f03df-2157-483a-8fda-6c9f662b65cb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:56.331367 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ec8f03df-2157-483a-8fda-6c9f662b65cb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:56.337953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec8f03df-2157-483a-8fda-6c9f662b65cb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:56.338436 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec8f03df-2157-483a-8fda-6c9f662b65cb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:56.338875 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec8f03df-2157-483a-8fda-6c9f662b65cb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:56.339566 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec8f03df-2157-483a-8fda-6c9f662b65cb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:56.340026 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec8f03df-2157-483a-8fda-6c9f662b65cb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:56.340452 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ec8f03df-2157-483a-8fda-6c9f662b65cb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:56.353860 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-ec8f03df-2157-483a-8fda-6c9f662b65cb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ec8f03df-2157-483a-8fda-6c9f662b65cb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 HTTP/1.1 Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:49:56.355457 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:49:56.357109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:49:56.357109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:56.357109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:56.357109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:56.357109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:56.357109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:49:56.357109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:49:56.357109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:49:56.357109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:56.357109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:49:56.357109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:56.357109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '833ddab4-258d-4891-bad4-8401df08a3e0'} Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:49:56.358151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:56.359687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:56.361081 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ec8f03df-2157-483a-8fda-6c9f662b65cb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 404 to user: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:49:56.361081 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ec8f03df-2157-483a-8fda-6c9f662b65cb tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 404 len: 111 microversion: 2.1 time: 0.030974 Aug 17 19:49:56.361081 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 459/923] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:56 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:49:56.365729 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-fccbfcf8-6685-4b80-8b5d-7577d4005264 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '.version_select at 0x7f3689fd4ca0>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:56.385657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-fccbfcf8-6685-4b80-8b5d-7577d4005264 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578428112" status: 202 len: 0 microversion: 2.1 time: 0.023792 Aug 17 19:49:56.386213 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 465/924] 10.222.0.59 () {58 vars in 1221 bytes} [Wed Aug 17 19:49:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1578428112 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:49:58.123684 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-bd116005-49fe-4937-b291-33d9c02aa453 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:58.124186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-bd116005-49fe-4937-b291-33d9c02aa453 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:58.131144 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bd116005-49fe-4937-b291-33d9c02aa453 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:58.131631 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bd116005-49fe-4937-b291-33d9c02aa453 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:58.132064 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bd116005-49fe-4937-b291-33d9c02aa453 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:58.132751 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bd116005-49fe-4937-b291-33d9c02aa453 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:58.133203 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bd116005-49fe-4937-b291-33d9c02aa453 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:58.133655 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-bd116005-49fe-4937-b291-33d9c02aa453 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:58.147089 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-bd116005-49fe-4937-b291-33d9c02aa453 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-bd116005-49fe-4937-b291-33d9c02aa453 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: DELETE /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 HTTP/1.1 Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:49:58.148606 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:49:58.150178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:49:58.150178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:58.150178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:58.150178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:58.150178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:58.150178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:49:58.150178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:49:58.150178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:49:58.150178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:58.150178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:49:58.150178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:58.150178 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '833ddab4-258d-4891-bad4-8401df08a3e0'} Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:49:58.151733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:58.153186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:58.154692 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-bd116005-49fe-4937-b291-33d9c02aa453 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 404 to user: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:49:58.154692 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-bd116005-49fe-4937-b291-33d9c02aa453 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 404 len: 111 microversion: 2.1 time: 0.030488 Aug 17 19:49:58.154692 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 460/925] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:49:58 2022] DELETE /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:49:58.158435 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-10636892-6255-4d77-aabb-97ea7bc93c3d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:58.159056 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-10636892-6255-4d77-aabb-97ea7bc93c3d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 833ddab4-258d-4891-bad4-8401df08a3e0] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:58.165946 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-10636892-6255-4d77-aabb-97ea7bc93c3d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:58.166433 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-10636892-6255-4d77-aabb-97ea7bc93c3d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:58.166875 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-10636892-6255-4d77-aabb-97ea7bc93c3d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:58.167570 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-10636892-6255-4d77-aabb-97ea7bc93c3d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:58.168028 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-10636892-6255-4d77-aabb-97ea7bc93c3d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:58.168455 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-10636892-6255-4d77-aabb-97ea7bc93c3d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:58.181193 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-10636892-6255-4d77-aabb-97ea7bc93c3d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-10636892-6255-4d77-aabb-97ea7bc93c3d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 HTTP/1.1 Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:49:58.182857 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:49:58.184777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:49:58.184777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:58.184777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:58.184777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:58.184777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:58.184777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:49:58.184777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:49:58.184777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:49:58.184777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:58.184777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:49:58.184777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:58.184777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '833ddab4-258d-4891-bad4-8401df08a3e0'} Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:49:58.186221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. Aug 17 19:49:58.188224 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:58.190199 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-10636892-6255-4d77-aabb-97ea7bc93c3d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 404 to user: Instance 833ddab4-258d-4891-bad4-8401df08a3e0 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:49:58.190199 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-10636892-6255-4d77-aabb-97ea7bc93c3d tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0" status: 404 len: 111 microversion: 2.1 time: 0.029693 Aug 17 19:49:58.190199 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 466/926] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:58 2022] GET /compute/v2.1/servers/833ddab4-258d-4891-bad4-8401df08a3e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:49:59.321992 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5fc3628d-d9b0-4e65-9904-5be03378ebd1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:59.322477 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-5fc3628d-d9b0-4e65-9904-5be03378ebd1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:59.329147 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5fc3628d-d9b0-4e65-9904-5be03378ebd1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:59.329666 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5fc3628d-d9b0-4e65-9904-5be03378ebd1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:59.330104 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5fc3628d-d9b0-4e65-9904-5be03378ebd1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:59.331286 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5fc3628d-d9b0-4e65-9904-5be03378ebd1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:59.331745 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5fc3628d-d9b0-4e65-9904-5be03378ebd1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:59.332174 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-5fc3628d-d9b0-4e65-9904-5be03378ebd1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:59.345105 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-5fc3628d-d9b0-4e65-9904-5be03378ebd1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5fc3628d-d9b0-4e65-9904-5be03378ebd1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: DELETE /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 HTTP/1.1 Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:49:59.347305 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:49:59.348944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:49:59.348944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:59.348944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:59.348944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:59.348944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:59.348944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:49:59.348944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:49:59.348944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:49:59.348944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:59.348944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:49:59.348944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:49:59.348944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': 'b2abccd0-4628-4403-bab1-66eac1ca2712'} Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:49:59.349871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:49:59.351382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.353192 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-5fc3628d-d9b0-4e65-9904-5be03378ebd1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 404 to user: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:49:59.353192 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-5fc3628d-d9b0-4e65-9904-5be03378ebd1 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 404 len: 111 microversion: 2.1 time: 0.030559 Aug 17 19:49:59.353192 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 461/927] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:49:59 2022] DELETE /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:49:59.356969 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-48557f21-dc24-47c7-9c08-afbe3d763af5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:59.357606 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-48557f21-dc24-47c7-9c08-afbe3d763af5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: b2abccd0-4628-4403-bab1-66eac1ca2712] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:59.363982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-48557f21-dc24-47c7-9c08-afbe3d763af5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:59.364452 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-48557f21-dc24-47c7-9c08-afbe3d763af5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:59.364880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-48557f21-dc24-47c7-9c08-afbe3d763af5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:59.365588 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-48557f21-dc24-47c7-9c08-afbe3d763af5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:59.366029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-48557f21-dc24-47c7-9c08-afbe3d763af5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:59.366443 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-48557f21-dc24-47c7-9c08-afbe3d763af5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:59.379785 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-48557f21-dc24-47c7-9c08-afbe3d763af5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-48557f21-dc24-47c7-9c08-afbe3d763af5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 HTTP/1.1 Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:49:59.381369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:49:59.382912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:49:59.382912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:59.382912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:59.382912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:59.382912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:59.382912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:49:59.382912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:49:59.382912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:49:59.382912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:59.382912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:49:59.382912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:49:59.382912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': 'b2abccd0-4628-4403-bab1-66eac1ca2712'} Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:49:59.383874 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. Aug 17 19:49:59.385337 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.386655 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-48557f21-dc24-47c7-9c08-afbe3d763af5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 404 to user: Instance b2abccd0-4628-4403-bab1-66eac1ca2712 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:49:59.386655 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-48557f21-dc24-47c7-9c08-afbe3d763af5 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712" status: 404 len: 111 microversion: 2.1 time: 0.029619 Aug 17 19:49:59.386655 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 467/928] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:59 2022] GET /compute/v2.1/servers/b2abccd0-4628-4403-bab1-66eac1ca2712 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:49:59.391229 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-41a4fe04-25c9-4805-b16d-20541178090f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:59.391729 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-41a4fe04-25c9-4805-b16d-20541178090f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:59.398188 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-41a4fe04-25c9-4805-b16d-20541178090f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:59.398670 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-41a4fe04-25c9-4805-b16d-20541178090f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:59.399107 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-41a4fe04-25c9-4805-b16d-20541178090f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:59.399798 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-41a4fe04-25c9-4805-b16d-20541178090f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:59.400429 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-41a4fe04-25c9-4805-b16d-20541178090f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:59.400866 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-41a4fe04-25c9-4805-b16d-20541178090f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:59.414445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-41a4fe04-25c9-4805-b16d-20541178090f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-41a4fe04-25c9-4805-b16d-20541178090f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: DELETE /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 HTTP/1.1 Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:49:59.415949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:49:59.417495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:49:59.417495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:59.417495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:59.417495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:59.417495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:59.417495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:49:59.417495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:49:59.417495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:49:59.417495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:59.417495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:49:59.417495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:49:59.417495 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '368e12e0-cb5a-4ad5-a293-ab7086cf4e95'} Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:49:59.418514 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:49:59.419859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.421521 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-41a4fe04-25c9-4805-b16d-20541178090f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 404 to user: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:49:59.421521 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-41a4fe04-25c9-4805-b16d-20541178090f tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 404 len: 111 microversion: 2.1 time: 0.029919 Aug 17 19:49:59.421521 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 462/929] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:49:59 2022] DELETE /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:49:59.426545 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ad49a51e-31e6-40de-b991-79d9b5c301da tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:49:59.427148 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ad49a51e-31e6-40de-b991-79d9b5c301da tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 368e12e0-cb5a-4ad5-a293-ab7086cf4e95] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:49:59.432963 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ad49a51e-31e6-40de-b991-79d9b5c301da tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:59.433480 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ad49a51e-31e6-40de-b991-79d9b5c301da tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:59.433911 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ad49a51e-31e6-40de-b991-79d9b5c301da tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:59.434586 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ad49a51e-31e6-40de-b991-79d9b5c301da tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:49:59.435034 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ad49a51e-31e6-40de-b991-79d9b5c301da tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:49:59.435460 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ad49a51e-31e6-40de-b991-79d9b5c301da tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:49:59.448474 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-ad49a51e-31e6-40de-b991-79d9b5c301da tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ad49a51e-31e6-40de-b991-79d9b5c301da tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 HTTP/1.1 Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:49:59.449982 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:49:59.451908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:49:59.451908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:59.451908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:49:59.451908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:49:59.451908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:59.451908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:49:59.451908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:49:59.451908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:49:59.451908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:49:59.451908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:49:59.451908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:49:59.451908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '368e12e0-cb5a-4ad5-a293-ab7086cf4e95'} Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:49:59.452677 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. Aug 17 19:49:59.453958 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:49:59.455039 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ad49a51e-31e6-40de-b991-79d9b5c301da tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 404 to user: Instance 368e12e0-cb5a-4ad5-a293-ab7086cf4e95 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:49:59.455039 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ad49a51e-31e6-40de-b991-79d9b5c301da tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95" status: 404 len: 111 microversion: 2.1 time: 0.028772 Aug 17 19:49:59.455039 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 468/930] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:49:59 2022] GET /compute/v2.1/servers/368e12e0-cb5a-4ad5-a293-ab7086cf4e95 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:50:00.587094 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-745c7e38-bcce-42c1-bf91-a2c0c8427d7e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:50:00.587602 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-745c7e38-bcce-42c1-bf91-a2c0c8427d7e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:50:00.593924 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-745c7e38-bcce-42c1-bf91-a2c0c8427d7e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:50:00.594408 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-745c7e38-bcce-42c1-bf91-a2c0c8427d7e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:50:00.594847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-745c7e38-bcce-42c1-bf91-a2c0c8427d7e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:50:00.595538 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-745c7e38-bcce-42c1-bf91-a2c0c8427d7e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:50:00.596502 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-745c7e38-bcce-42c1-bf91-a2c0c8427d7e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:50:00.596928 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-745c7e38-bcce-42c1-bf91-a2c0c8427d7e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:50:00.609863 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-745c7e38-bcce-42c1-bf91-a2c0c8427d7e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-745c7e38-bcce-42c1-bf91-a2c0c8427d7e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: DELETE /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 HTTP/1.1 Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:50:00.611410 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:50:00.613710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:50:00.613710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:50:00.613710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:50:00.613710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:50:00.613710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:50:00.613710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:50:00.613710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:50:00.613710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:50:00.613710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:50:00.613710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:50:00.613710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:50:00.613710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '78428449-8788-42ec-bdb0-1ee8723c3ea3'} Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:50:00.614634 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:50:00.616135 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:50:00.617730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-745c7e38-bcce-42c1-bf91-a2c0c8427d7e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 404 to user: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:50:00.617730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-745c7e38-bcce-42c1-bf91-a2c0c8427d7e tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "DELETE /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 404 len: 111 microversion: 2.1 time: 0.030126 Aug 17 19:50:00.617730 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 463/931] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:50:00 2022] DELETE /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:50:00.621589 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3623fb54-963c-4425-8161-4446f8a8bc01 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:50:00.622213 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3623fb54-963c-4425-8161-4446f8a8bc01 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] [instance: 78428449-8788-42ec-bdb0-1ee8723c3ea3] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:50:00.628464 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3623fb54-963c-4425-8161-4446f8a8bc01 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:50:00.628946 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3623fb54-963c-4425-8161-4446f8a8bc01 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:50:00.629432 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3623fb54-963c-4425-8161-4446f8a8bc01 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:50:00.630127 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3623fb54-963c-4425-8161-4446f8a8bc01 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:50:00.630585 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3623fb54-963c-4425-8161-4446f8a8bc01 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:50:00.631012 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3623fb54-963c-4425-8161-4446f8a8bc01 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:50:00.644076 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-3623fb54-963c-4425-8161-4446f8a8bc01 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] HTTP exception thrown: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3623fb54-963c-4425-8161-4446f8a8bc01 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Request method failure captured: Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 HTTP/1.1 Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UVaGOBgLmZAjhIsL7nGJWNZt7oMPRkaY2k6LDE69plzyPep1jWDsJBSECkG7jdlCyunTSC5HsDBKJgy7IZZGUIKExKMw669G_s20jT_cCnN7PV0c4jAigtreJCSMUtgCZVAbrLl2XFVDQ8fa1o89sHW37LqI2VXxG1tE5e3XTFDNJE Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:50:00.645595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:50:00.647217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/d48524fb6ff040dcac98b23363268772"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_d48524fb6ff040dcac98b23363268772", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/d48524fb6ff040dcac98b23363268772"}]}] Aug 17 19:50:00.647217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:50:00.647217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: d48524fb6ff040dcac98b23363268772 Aug 17 19:50:00.647217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528953303 Aug 17 19:50:00.647217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:50:00.647217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:50:00.647217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:50:00.647217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 22406c8108a4408aa39c5d174d032e20 Aug 17 19:50:00.647217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-AttachVolumeNegativeTest-528953303-project Aug 17 19:50:00.647217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:50:00.647217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:50:00.647217 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '78428449-8788-42ec-bdb0-1ee8723c3ea3'} Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:50:00.648135 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. Aug 17 19:50:00.649657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:50:00.651315 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3623fb54-963c-4425-8161-4446f8a8bc01 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] Returning 404 to user: Instance 78428449-8788-42ec-bdb0-1ee8723c3ea3 could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:50:00.651315 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3623fb54-963c-4425-8161-4446f8a8bc01 tempest-AttachVolumeNegativeTest-528953303 tempest-AttachVolumeNegativeTest-528953303-project] 10.222.0.59 "GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3" status: 404 len: 111 microversion: 2.1 time: 0.029148 Aug 17 19:50:00.651315 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 469/932] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:50:00 2022] GET /compute/v2.1/servers/78428449-8788-42ec-bdb0-1ee8723c3ea3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:50:53.034233 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 19:50:53.035170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Wed Aug 17 19:50:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 19:50:56.422638 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=20 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:50:56.423856 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:50:56.605013 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2ffb3262-f18a-495b-a279-ca299bed6e8a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Action: 'create', calling method: .version_select at 0x7f368a578ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1248518498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8qIV9E5hCrggN6bZWr8iCkueQY2aSqg4KlBTOXyby3wan1foCtjcJ0jjN03NPZfrBr1PopL2WK0d4Pa0OOBbMOX6oEkhZpJXC4M8JH/q/fGZ71aaJVH9fINtkXiHChMA=="}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:50:56.622364 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-2ffb3262-f18a-495b-a279-ca299bed6e8a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Getting quotas for project aff3b32658054cff96939af2ce92fd7b. Resources: {'key_pairs'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:50:56.626362 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-2ffb3262-f18a-495b-a279-ca299bed6e8a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Getting quotas for user 7b632d0e7dc64db79487d1d253c96cda and project aff3b32658054cff96939af2ce92fd7b. Resources: {'key_pairs'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:50:56.652108 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2ffb3262-f18a-495b-a279-ca299bed6e8a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.238770 Aug 17 19:50:56.652710 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 464/933] 10.222.0.59 () {60 vars in 1159 bytes} [Wed Aug 17 19:50:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 19:51:11.826624 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:51:11.827405 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:51:11.831390 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-218823906", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1248518498", "security_groups": [{"name": "tempest-secgroup-smoke-2091540201"}], "block_device_mapping_v2": [{"uuid": "a2595f28-c904-4104-973d-5dff246f0d72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b9833d36-2800-444b-a953-b1f217939327"}]}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:51:11.949615 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.network.neutron [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] validate_networks() for [('b9833d36-2800-444b-a953-b1f217939327', None, None, None, None, None)] {{(pid=132531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:51:12.314282 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Flavor limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:51:12.314707 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Image limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:51:12.315179 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Flavor pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:51:12.315587 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Image pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:51:12.315994 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:51:12.325111 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:12.325623 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:12.326793 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:12.327011 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:12.327457 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:12.327876 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:12.345414 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Getting quotas for project aff3b32658054cff96939af2ce92fd7b. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:51:12.349319 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Getting quotas for user 7b632d0e7dc64db79487d1d253c96cda and project aff3b32658054cff96939af2ce92fd7b. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:51:12.405659 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Going to run 1 instances... {{(pid=132531) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:51:12.407744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2595f28-c904-4104-973d-5dff246f0d72',volume_size=None,volume_type=None)] {{(pid=132531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:51:12.536528 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0d9d4083-f69d-4439-a1c3-b2a4f4fb2c99 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711951 Aug 17 19:51:12.537165 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 470/934] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:51:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:51:12.545561 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=4 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:51:12.546481 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:51:12.550920 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4793a3a5-6f86-430a-b529-946e709d7e6f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:12.551538 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4793a3a5-6f86-430a-b529-946e709d7e6f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:12.607404 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-4793a3a5-6f86-430a-b529-946e709d7e6f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:12.614029 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4793a3a5-6f86-430a-b529-946e709d7e6f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1094 microversion: 2.1 time: 0.069870 Aug 17 19:51:12.614741 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 465/935] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:12 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:13.635171 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-925f904c-acd4-44a8-ad76-4b9960c628de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:13.635793 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-925f904c-acd4-44a8-ad76-4b9960c628de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:13.643580 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-925f904c-acd4-44a8-ad76-4b9960c628de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:13.644129 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-925f904c-acd4-44a8-ad76-4b9960c628de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:13.644703 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-925f904c-acd4-44a8-ad76-4b9960c628de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:13.645537 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-925f904c-acd4-44a8-ad76-4b9960c628de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:13.645891 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-925f904c-acd4-44a8-ad76-4b9960c628de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:13.646325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-925f904c-acd4-44a8-ad76-4b9960c628de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:13.713700 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-925f904c-acd4-44a8-ad76-4b9960c628de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:13.723225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-925f904c-acd4-44a8-ad76-4b9960c628de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1210 microversion: 2.1 time: 0.092107 Aug 17 19:51:13.724178 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 471/936] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:13 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:14.744074 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-aac5bcf8-8e18-4567-bcf0-998a13ae1891 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:14.744820 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-aac5bcf8-8e18-4567-bcf0-998a13ae1891 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:14.752997 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aac5bcf8-8e18-4567-bcf0-998a13ae1891 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:14.753541 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aac5bcf8-8e18-4567-bcf0-998a13ae1891 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:14.753978 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aac5bcf8-8e18-4567-bcf0-998a13ae1891 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:14.754704 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aac5bcf8-8e18-4567-bcf0-998a13ae1891 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:14.755159 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aac5bcf8-8e18-4567-bcf0-998a13ae1891 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:14.755580 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aac5bcf8-8e18-4567-bcf0-998a13ae1891 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:15.047889 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-6e286ef8-f913-4b7c-bbcc-84d2a5a879f7 req-64662ec4-3b3e-44de-8669-3b88621d41c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "812369db-d8e2-4ad9-9f0f-044a9589c89d", "tag": "0e5f317a-6bf1-41cd-8399-bb93514cb1cf"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:51:15.059473 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-6e286ef8-f913-4b7c-bbcc-84d2a5a879f7 req-64662ec4-3b3e-44de-8669-3b88621d41c8 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:15.059956 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-6e286ef8-f913-4b7c-bbcc-84d2a5a879f7 req-64662ec4-3b3e-44de-8669-3b88621d41c8 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:15.060591 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-6e286ef8-f913-4b7c-bbcc-84d2a5a879f7 req-64662ec4-3b3e-44de-8669-3b88621d41c8 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:15.072085 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-6e286ef8-f913-4b7c-bbcc-84d2a5a879f7 req-64662ec4-3b3e-44de-8669-3b88621d41c8 service nova] Creating event network-changed:0e5f317a-6bf1-41cd-8399-bb93514cb1cf for instance 812369db-d8e2-4ad9-9f0f-044a9589c89d on hv-cinder-85069 Aug 17 19:51:15.078075 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-6e286ef8-f913-4b7c-bbcc-84d2a5a879f7 req-64662ec4-3b3e-44de-8669-3b88621d41c8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111489 Aug 17 19:51:15.078662 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 472/937] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:51:15.125692 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-aac5bcf8-8e18-4567-bcf0-998a13ae1891 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:15.133225 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-aac5bcf8-8e18-4567-bcf0-998a13ae1891 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1266 microversion: 2.1 time: 0.393120 Aug 17 19:51:15.133801 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 466/938] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:14 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1266 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:16.154915 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-37b954ba-59d7-41fc-a149-7b51138d750c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:16.155602 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-37b954ba-59d7-41fc-a149-7b51138d750c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:16.162083 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-37b954ba-59d7-41fc-a149-7b51138d750c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:16.162557 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-37b954ba-59d7-41fc-a149-7b51138d750c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:16.162985 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-37b954ba-59d7-41fc-a149-7b51138d750c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:16.163663 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-37b954ba-59d7-41fc-a149-7b51138d750c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:16.164110 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-37b954ba-59d7-41fc-a149-7b51138d750c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:16.164605 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-37b954ba-59d7-41fc-a149-7b51138d750c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:16.296500 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-37b954ba-59d7-41fc-a149-7b51138d750c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:16.304082 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-37b954ba-59d7-41fc-a149-7b51138d750c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1266 microversion: 2.1 time: 0.153341 Aug 17 19:51:16.304643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 473/939] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:16 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:17.324355 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-97975f20-eae9-484d-bf8f-73ebab137bb8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:17.324897 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-97975f20-eae9-484d-bf8f-73ebab137bb8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:17.331821 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-97975f20-eae9-484d-bf8f-73ebab137bb8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:17.332309 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-97975f20-eae9-484d-bf8f-73ebab137bb8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:17.332746 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-97975f20-eae9-484d-bf8f-73ebab137bb8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:17.333475 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-97975f20-eae9-484d-bf8f-73ebab137bb8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:17.333932 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-97975f20-eae9-484d-bf8f-73ebab137bb8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:17.334361 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-97975f20-eae9-484d-bf8f-73ebab137bb8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:17.464317 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-97975f20-eae9-484d-bf8f-73ebab137bb8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:17.471741 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-97975f20-eae9-484d-bf8f-73ebab137bb8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1266 microversion: 2.1 time: 0.151935 Aug 17 19:51:17.472295 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 467/940] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:17 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:18.492073 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-12cf413b-bb47-4f03-9e7a-730abe713246 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:18.493890 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-12cf413b-bb47-4f03-9e7a-730abe713246 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:18.499761 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12cf413b-bb47-4f03-9e7a-730abe713246 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:18.500241 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12cf413b-bb47-4f03-9e7a-730abe713246 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:18.500671 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12cf413b-bb47-4f03-9e7a-730abe713246 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:18.501459 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12cf413b-bb47-4f03-9e7a-730abe713246 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:18.501912 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12cf413b-bb47-4f03-9e7a-730abe713246 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:18.502332 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-12cf413b-bb47-4f03-9e7a-730abe713246 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:18.629525 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-12cf413b-bb47-4f03-9e7a-730abe713246 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:18.636949 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-12cf413b-bb47-4f03-9e7a-730abe713246 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1266 microversion: 2.1 time: 0.148752 Aug 17 19:51:18.637551 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 474/941] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:18 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:19.657919 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a3ae0005-d429-457b-ad87-5360dba938ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:19.658531 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a3ae0005-d429-457b-ad87-5360dba938ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:19.664833 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a3ae0005-d429-457b-ad87-5360dba938ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:19.665337 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a3ae0005-d429-457b-ad87-5360dba938ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:19.665771 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a3ae0005-d429-457b-ad87-5360dba938ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:19.666451 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a3ae0005-d429-457b-ad87-5360dba938ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:19.666899 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a3ae0005-d429-457b-ad87-5360dba938ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:19.667825 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a3ae0005-d429-457b-ad87-5360dba938ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:19.798125 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-a3ae0005-d429-457b-ad87-5360dba938ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:19.805642 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a3ae0005-d429-457b-ad87-5360dba938ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1266 microversion: 2.1 time: 0.151555 Aug 17 19:51:19.806190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 468/942] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:19 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:20.828402 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3375356b-f7ad-43e2-8e2a-be5eaca5061e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:20.829041 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3375356b-f7ad-43e2-8e2a-be5eaca5061e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:20.834999 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3375356b-f7ad-43e2-8e2a-be5eaca5061e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:20.835501 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3375356b-f7ad-43e2-8e2a-be5eaca5061e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:20.835924 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3375356b-f7ad-43e2-8e2a-be5eaca5061e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:20.836649 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3375356b-f7ad-43e2-8e2a-be5eaca5061e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:20.837105 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3375356b-f7ad-43e2-8e2a-be5eaca5061e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:20.837629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3375356b-f7ad-43e2-8e2a-be5eaca5061e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:20.965716 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3375356b-f7ad-43e2-8e2a-be5eaca5061e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:20.973164 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3375356b-f7ad-43e2-8e2a-be5eaca5061e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1266 microversion: 2.1 time: 0.150257 Aug 17 19:51:20.973748 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 475/943] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:20 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:21.993929 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-15097ac1-89f8-4df7-b9e5-15975733cfa0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:21.994570 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-15097ac1-89f8-4df7-b9e5-15975733cfa0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:22.001475 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-15097ac1-89f8-4df7-b9e5-15975733cfa0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:22.001954 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-15097ac1-89f8-4df7-b9e5-15975733cfa0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:22.002387 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-15097ac1-89f8-4df7-b9e5-15975733cfa0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:22.003073 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-15097ac1-89f8-4df7-b9e5-15975733cfa0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:22.003520 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-15097ac1-89f8-4df7-b9e5-15975733cfa0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:22.003939 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-15097ac1-89f8-4df7-b9e5-15975733cfa0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:22.135799 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-15097ac1-89f8-4df7-b9e5-15975733cfa0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:22.143239 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-15097ac1-89f8-4df7-b9e5-15975733cfa0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1266 microversion: 2.1 time: 0.153141 Aug 17 19:51:22.143785 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 469/944] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:21 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:23.163601 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-841d7bf7-c887-411c-a344-0d97c409355b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:23.164251 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-841d7bf7-c887-411c-a344-0d97c409355b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:23.166697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:51:23.167368 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=6 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:51:23.173618 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-841d7bf7-c887-411c-a344-0d97c409355b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:23.174133 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-841d7bf7-c887-411c-a344-0d97c409355b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:23.174575 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-841d7bf7-c887-411c-a344-0d97c409355b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:23.175268 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-841d7bf7-c887-411c-a344-0d97c409355b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:23.175724 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-841d7bf7-c887-411c-a344-0d97c409355b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:23.176153 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-841d7bf7-c887-411c-a344-0d97c409355b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:23.306891 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-841d7bf7-c887-411c-a344-0d97c409355b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:23.314336 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-841d7bf7-c887-411c-a344-0d97c409355b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1266 microversion: 2.1 time: 0.154655 Aug 17 19:51:23.314889 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 476/945] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:23 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:24.334880 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ae512652-1835-4278-b27a-cfbdf6db7d3b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:24.335497 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ae512652-1835-4278-b27a-cfbdf6db7d3b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:24.337400 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:51:24.343316 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ae512652-1835-4278-b27a-cfbdf6db7d3b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:24.343805 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ae512652-1835-4278-b27a-cfbdf6db7d3b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:24.344248 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ae512652-1835-4278-b27a-cfbdf6db7d3b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:24.344940 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ae512652-1835-4278-b27a-cfbdf6db7d3b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:24.345452 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ae512652-1835-4278-b27a-cfbdf6db7d3b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:24.345879 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-ae512652-1835-4278-b27a-cfbdf6db7d3b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:24.475568 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ae512652-1835-4278-b27a-cfbdf6db7d3b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:24.483443 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ae512652-1835-4278-b27a-cfbdf6db7d3b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1266 microversion: 2.1 time: 0.152426 Aug 17 19:51:24.483994 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 470/946] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:24 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:24.732657 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-790c711c-afe1-4256-ac0a-108dab354cbe req-d579b827-7960-4233-8a81-16386ea428cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812369db-d8e2-4ad9-9f0f-044a9589c89d", "name": "network-vif-plugged", "status": "completed", "tag": "0e5f317a-6bf1-41cd-8399-bb93514cb1cf"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:51:24.742552 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-790c711c-afe1-4256-ac0a-108dab354cbe req-d579b827-7960-4233-8a81-16386ea428cd service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:24.743032 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-790c711c-afe1-4256-ac0a-108dab354cbe req-d579b827-7960-4233-8a81-16386ea428cd service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:24.743499 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-790c711c-afe1-4256-ac0a-108dab354cbe req-d579b827-7960-4233-8a81-16386ea428cd service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:24.754591 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-790c711c-afe1-4256-ac0a-108dab354cbe req-d579b827-7960-4233-8a81-16386ea428cd service nova] Creating event network-vif-plugged:0e5f317a-6bf1-41cd-8399-bb93514cb1cf for instance 812369db-d8e2-4ad9-9f0f-044a9589c89d on hv-cinder-85069 Aug 17 19:51:24.759513 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-790c711c-afe1-4256-ac0a-108dab354cbe req-d579b827-7960-4233-8a81-16386ea428cd service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088168 Aug 17 19:51:24.760371 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 477/947] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:51:25.504577 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4160f0ab-7937-4735-8484-fa354b3474f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:25.505124 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4160f0ab-7937-4735-8484-fa354b3474f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:25.511152 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4160f0ab-7937-4735-8484-fa354b3474f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:25.511643 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4160f0ab-7937-4735-8484-fa354b3474f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:25.512077 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4160f0ab-7937-4735-8484-fa354b3474f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:25.512766 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4160f0ab-7937-4735-8484-fa354b3474f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:25.513239 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4160f0ab-7937-4735-8484-fa354b3474f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:25.513666 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4160f0ab-7937-4735-8484-fa354b3474f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:25.647775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-4160f0ab-7937-4735-8484-fa354b3474f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:25.655898 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4160f0ab-7937-4735-8484-fa354b3474f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1266 microversion: 2.1 time: 0.155396 Aug 17 19:51:25.656454 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 471/948] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:25 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:26.676641 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0d88c398-f05b-4765-8e14-16c685a7a689 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:26.677366 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0d88c398-f05b-4765-8e14-16c685a7a689 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:26.683608 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0d88c398-f05b-4765-8e14-16c685a7a689 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:26.684085 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0d88c398-f05b-4765-8e14-16c685a7a689 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:26.684539 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0d88c398-f05b-4765-8e14-16c685a7a689 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:26.685200 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0d88c398-f05b-4765-8e14-16c685a7a689 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:26.685675 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0d88c398-f05b-4765-8e14-16c685a7a689 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:26.686097 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0d88c398-f05b-4765-8e14-16c685a7a689 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:26.819567 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0d88c398-f05b-4765-8e14-16c685a7a689 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:26.828166 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0d88c398-f05b-4765-8e14-16c685a7a689 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1453 microversion: 2.1 time: 0.156171 Aug 17 19:51:26.828897 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 478/949] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:26 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:26.851538 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b418e601-36c4-4631-9aff-ed34a53c489b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:51:26.852158 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b418e601-36c4-4631-9aff-ed34a53c489b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:51:26.858525 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b418e601-36c4-4631-9aff-ed34a53c489b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:26.859011 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b418e601-36c4-4631-9aff-ed34a53c489b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:26.859452 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b418e601-36c4-4631-9aff-ed34a53c489b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:26.860176 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b418e601-36c4-4631-9aff-ed34a53c489b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:26.860616 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b418e601-36c4-4631-9aff-ed34a53c489b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:26.861044 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b418e601-36c4-4631-9aff-ed34a53c489b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:26.991687 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b418e601-36c4-4631-9aff-ed34a53c489b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:51:26.999686 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b418e601-36c4-4631-9aff-ed34a53c489b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1453 microversion: 2.1 time: 0.152062 Aug 17 19:51:27.000247 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 472/950] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:51:26 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:51:28.820466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-53b3f2fa-8bd3-4f19-b63c-9be93d67a2a1 req-4e1e145e-b61d-4c67-81ac-cc2c40cc9d2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "812369db-d8e2-4ad9-9f0f-044a9589c89d", "tag": "0e5f317a-6bf1-41cd-8399-bb93514cb1cf"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:51:28.830836 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-53b3f2fa-8bd3-4f19-b63c-9be93d67a2a1 req-4e1e145e-b61d-4c67-81ac-cc2c40cc9d2c service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:51:28.831309 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-53b3f2fa-8bd3-4f19-b63c-9be93d67a2a1 req-4e1e145e-b61d-4c67-81ac-cc2c40cc9d2c service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:51:28.831730 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-53b3f2fa-8bd3-4f19-b63c-9be93d67a2a1 req-4e1e145e-b61d-4c67-81ac-cc2c40cc9d2c service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:51:28.843446 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-53b3f2fa-8bd3-4f19-b63c-9be93d67a2a1 req-4e1e145e-b61d-4c67-81ac-cc2c40cc9d2c service nova] Creating event network-changed:0e5f317a-6bf1-41cd-8399-bb93514cb1cf for instance 812369db-d8e2-4ad9-9f0f-044a9589c89d on hv-cinder-85069 Aug 17 19:51:28.848262 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-53b3f2fa-8bd3-4f19-b63c-9be93d67a2a1 req-4e1e145e-b61d-4c67-81ac-cc2c40cc9d2c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031506 Aug 17 19:51:28.848881 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 479/951] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:52:33.005478 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 19:52:33.006044 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Wed Aug 17 19:52:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 19:52:49.010738 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 19:52:49.011213 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Wed Aug 17 19:52:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 19:53:24.191713 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=18 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:53:24.192739 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=42 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:53:24.198163 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-4bc029b5-d9bc-4cfc-9b48-253bd6541e3f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:24.198662 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4bc029b5-d9bc-4cfc-9b48-253bd6541e3f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:24.205589 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4bc029b5-d9bc-4cfc-9b48-253bd6541e3f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:24.206075 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4bc029b5-d9bc-4cfc-9b48-253bd6541e3f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:24.206511 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4bc029b5-d9bc-4cfc-9b48-253bd6541e3f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:24.207203 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4bc029b5-d9bc-4cfc-9b48-253bd6541e3f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:24.207668 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4bc029b5-d9bc-4cfc-9b48-253bd6541e3f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:24.208093 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-4bc029b5-d9bc-4cfc-9b48-253bd6541e3f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:24.232818 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-4bc029b5-d9bc-4cfc-9b48-253bd6541e3f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Going to try to terminate instance {{(pid=132530) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:53:24.308357 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-4bc029b5-d9bc-4cfc-9b48-253bd6541e3f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "DELETE /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 204 len: 0 microversion: 2.1 time: 0.118560 Aug 17 19:53:24.309153 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 473/952] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:53:24 2022] DELETE /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:53:24.315667 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55195b0a-2b30-4ca3-ab47-6c9d26789947] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 17 19:53:24.316263 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:53:24.317001 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=44 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:53:24.321418 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-78c0bb3f-b1f4-4b10-93d2-5bfa504d3fa8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:24.322629 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-78c0bb3f-b1f4-4b10-93d2-5bfa504d3fa8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:24.330363 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-78c0bb3f-b1f4-4b10-93d2-5bfa504d3fa8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:24.330835 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-78c0bb3f-b1f4-4b10-93d2-5bfa504d3fa8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:24.331262 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-78c0bb3f-b1f4-4b10-93d2-5bfa504d3fa8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:24.331970 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-78c0bb3f-b1f4-4b10-93d2-5bfa504d3fa8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:24.332417 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-78c0bb3f-b1f4-4b10-93d2-5bfa504d3fa8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:24.332836 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-78c0bb3f-b1f4-4b10-93d2-5bfa504d3fa8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:24.464714 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-78c0bb3f-b1f4-4b10-93d2-5bfa504d3fa8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:24.472164 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-78c0bb3f-b1f4-4b10-93d2-5bfa504d3fa8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1578 microversion: 2.1 time: 0.158556 Aug 17 19:53:24.472717 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 480/953] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:24 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:25.493042 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-b89f5216-6e90-4129-9b71-42acd9b29bfb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:25.493766 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-b89f5216-6e90-4129-9b71-42acd9b29bfb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:25.499607 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b89f5216-6e90-4129-9b71-42acd9b29bfb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:25.500085 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b89f5216-6e90-4129-9b71-42acd9b29bfb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:25.500520 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b89f5216-6e90-4129-9b71-42acd9b29bfb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:25.501206 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b89f5216-6e90-4129-9b71-42acd9b29bfb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:25.501679 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b89f5216-6e90-4129-9b71-42acd9b29bfb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:25.502103 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-b89f5216-6e90-4129-9b71-42acd9b29bfb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:25.641023 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-b89f5216-6e90-4129-9b71-42acd9b29bfb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:25.648483 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-b89f5216-6e90-4129-9b71-42acd9b29bfb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1578 microversion: 2.1 time: 0.159854 Aug 17 19:53:25.649055 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 474/954] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:25 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:26.671057 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-0ea3bbb2-bfd8-4870-af84-180b129b4d8f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:26.672320 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-0ea3bbb2-bfd8-4870-af84-180b129b4d8f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:26.686029 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0ea3bbb2-bfd8-4870-af84-180b129b4d8f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:26.686544 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0ea3bbb2-bfd8-4870-af84-180b129b4d8f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:26.686972 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0ea3bbb2-bfd8-4870-af84-180b129b4d8f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:26.687680 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0ea3bbb2-bfd8-4870-af84-180b129b4d8f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:26.688242 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0ea3bbb2-bfd8-4870-af84-180b129b4d8f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:26.688675 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-0ea3bbb2-bfd8-4870-af84-180b129b4d8f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:26.694060 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-c3a19c45-a2aa-41bf-ab11-4873fb4503cf req-3cc0dc96-92ab-46f7-9bf7-a45fe4c5889b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "812369db-d8e2-4ad9-9f0f-044a9589c89d", "name": "network-vif-deleted", "tag": "0e5f317a-6bf1-41cd-8399-bb93514cb1cf"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:53:26.709136 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-c3a19c45-a2aa-41bf-ab11-4873fb4503cf req-3cc0dc96-92ab-46f7-9bf7-a45fe4c5889b service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:26.710058 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-c3a19c45-a2aa-41bf-ab11-4873fb4503cf req-3cc0dc96-92ab-46f7-9bf7-a45fe4c5889b service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:26.710724 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-c3a19c45-a2aa-41bf-ab11-4873fb4503cf req-3cc0dc96-92ab-46f7-9bf7-a45fe4c5889b service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:26.712998 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO oslo.messaging._drivers.impl_rabbit [-] [55195b0a-2b30-4ca3-ab47-6c9d26789947] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 56502. Aug 17 19:53:26.724386 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-c3a19c45-a2aa-41bf-ab11-4873fb4503cf req-3cc0dc96-92ab-46f7-9bf7-a45fe4c5889b service nova] Creating event network-vif-deleted:0e5f317a-6bf1-41cd-8399-bb93514cb1cf for instance 812369db-d8e2-4ad9-9f0f-044a9589c89d on hv-cinder-85069 Aug 17 19:53:26.730736 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-c3a19c45-a2aa-41bf-ab11-4873fb4503cf req-3cc0dc96-92ab-46f7-9bf7-a45fe4c5889b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045599 Aug 17 19:53:26.732171 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 475/955] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:53:26.767951 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-0ea3bbb2-bfd8-4870-af84-180b129b4d8f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:26.777858 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-0ea3bbb2-bfd8-4870-af84-180b129b4d8f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 200 len: 1510 microversion: 2.1 time: 0.110816 Aug 17 19:53:26.778821 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 481/956] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:26 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 1510 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:27.800799 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1abeb979-eacb-439c-bfb8-79481cdea9df tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:27.802285 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1abeb979-eacb-439c-bfb8-79481cdea9df tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:27.808513 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1abeb979-eacb-439c-bfb8-79481cdea9df tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:27.809116 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1abeb979-eacb-439c-bfb8-79481cdea9df tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:27.809589 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1abeb979-eacb-439c-bfb8-79481cdea9df tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:27.810352 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1abeb979-eacb-439c-bfb8-79481cdea9df tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:27.810809 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1abeb979-eacb-439c-bfb8-79481cdea9df tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:27.811238 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1abeb979-eacb-439c-bfb8-79481cdea9df tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:27.825157 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-1abeb979-eacb-439c-bfb8-79481cdea9df tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] HTTP exception thrown: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1abeb979-eacb-439c-bfb8-79481cdea9df tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Request method failure captured: Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d HTTP/1.1 Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UabdxprzT1mV1SFnd5pUkMMXi6qBWZqmzBzYbGDw4nEeVM0fkIrpuBAMRtkgAhPe0ZozFs9cz1yjn-xyDTVWEx5GdBdGW3LPK5MfIKC8Do9rt4whvu2LRYL-BG1_ComuHq8UbzS1TAP2clUY-NkZgeQOLUsckNVT55SeewMGJbpyTU Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: aff3b32658054cff96939af2ce92fd7b Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:53:27.826881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:53:27.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/aff3b32658054cff96939af2ce92fd7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/aff3b32658054cff96939af2ce92fd7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_aff3b32658054cff96939af2ce92fd7b", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/aff3b32658054cff96939af2ce92fd7b"}]}] Aug 17 19:53:27.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:53:27.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: aff3b32658054cff96939af2ce92fd7b Aug 17 19:53:27.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:53:27.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-TestVolumeBootPattern-1521606351-project Aug 17 19:53:27.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:53:27.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:53:27.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 7b632d0e7dc64db79487d1d253c96cda Aug 17 19:53:27.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-TestVolumeBootPattern-1521606351-project Aug 17 19:53:27.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:53:27.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:53:27.828732 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '812369db-d8e2-4ad9-9f0f-044a9589c89d'} Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:53:27.829660 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:53:27.830988 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:53:27.832188 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1abeb979-eacb-439c-bfb8-79481cdea9df tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Returning 404 to user: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:53:27.832188 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1abeb979-eacb-439c-bfb8-79481cdea9df tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 404 len: 111 microversion: 2.1 time: 0.032264 Aug 17 19:53:27.832188 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 476/957] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:27 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:53:27.878189 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-702648327", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1248518498", "security_groups": [{"name": "tempest-secgroup-smoke-2091540201"}], "block_device_mapping_v2": [{"uuid": "a2595f28-c904-4104-973d-5dff246f0d72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b9833d36-2800-444b-a953-b1f217939327"}]}} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:53:27.992948 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.network.neutron [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] validate_networks() for [('b9833d36-2800-444b-a953-b1f217939327', None, None, None, None, None)] {{(pid=132531) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:53:28.395640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Flavor limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:53:28.396060 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Image limits 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:53:28.396534 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Flavor pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:53:28.396942 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Image pref 0:0:0 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:53:28.397394 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.virt.hardware [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132531) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:53:28.406690 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:28.407170 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:28.407603 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:28.408331 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:28.408783 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:28.409222 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:28.426132 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Getting quotas for project aff3b32658054cff96939af2ce92fd7b. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:53:28.429971 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.quota [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Getting quotas for user 7b632d0e7dc64db79487d1d253c96cda and project aff3b32658054cff96939af2ce92fd7b. Resources: {'cores', 'ram', 'instances'} {{(pid=132531) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:53:28.486203 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Going to run 1 instances... {{(pid=132531) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:53:28.488334 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a2595f28-c904-4104-973d-5dff246f0d72',volume_size=None,volume_type=None)] {{(pid=132531) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:53:28.610747 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [a9ca9f68-4170-4cb6-bc7e-4ad51b0d54df] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 19:53:29.619244 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO oslo.messaging._drivers.impl_rabbit [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [a9ca9f68-4170-4cb6-bc7e-4ad51b0d54df] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 56528. Aug 17 19:53:29.623167 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9bc47f14-f8ba-4348-a255-882ae98d6831 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.748889 Aug 17 19:53:29.623809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 482/958] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:53:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 19:53:29.634568 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e74b5855-d252-4097-84ea-92edd47e44f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:29.635218 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e74b5855-d252-4097-84ea-92edd47e44f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:29.688067 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-e74b5855-d252-4097-84ea-92edd47e44f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:29.694760 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e74b5855-d252-4097-84ea-92edd47e44f9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1094 microversion: 2.1 time: 0.064016 Aug 17 19:53:29.695331 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 477/959] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:29 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:30.715880 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1a762c27-5792-4d97-8c60-06565e1b08ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:30.716494 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1a762c27-5792-4d97-8c60-06565e1b08ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:30.771945 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1a762c27-5792-4d97-8c60-06565e1b08ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:30.778513 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1a762c27-5792-4d97-8c60-06565e1b08ab tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1094 microversion: 2.1 time: 0.066926 Aug 17 19:53:30.779113 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 483/960] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:30 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:31.798374 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-ef4aca9c-bb85-4097-b496-a379eb0b52d1 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:31.798999 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-ef4aca9c-bb85-4097-b496-a379eb0b52d1 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:31.855275 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-ef4aca9c-bb85-4097-b496-a379eb0b52d1 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:31.861931 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-ef4aca9c-bb85-4097-b496-a379eb0b52d1 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1094 microversion: 2.1 time: 0.067345 Aug 17 19:53:31.862478 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 478/961] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:31 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:32.882957 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1983cbca-fe94-4b24-8de5-e424541e5e06 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:32.883602 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1983cbca-fe94-4b24-8de5-e424541e5e06 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:32.939648 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1983cbca-fe94-4b24-8de5-e424541e5e06 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:32.946223 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1983cbca-fe94-4b24-8de5-e424541e5e06 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1094 microversion: 2.1 time: 0.067195 Aug 17 19:53:32.947416 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 484/962] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:32 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:33.968580 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c80eb307-821c-40bf-a1aa-fde3d72d1588 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:33.969190 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c80eb307-821c-40bf-a1aa-fde3d72d1588 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:33.975775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c80eb307-821c-40bf-a1aa-fde3d72d1588 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:33.976248 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c80eb307-821c-40bf-a1aa-fde3d72d1588 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:33.976677 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c80eb307-821c-40bf-a1aa-fde3d72d1588 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:33.977390 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c80eb307-821c-40bf-a1aa-fde3d72d1588 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:33.977840 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c80eb307-821c-40bf-a1aa-fde3d72d1588 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:33.978261 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c80eb307-821c-40bf-a1aa-fde3d72d1588 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:34.038128 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c80eb307-821c-40bf-a1aa-fde3d72d1588 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:34.047467 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c80eb307-821c-40bf-a1aa-fde3d72d1588 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1144 microversion: 2.1 time: 0.083147 Aug 17 19:53:34.048040 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 479/963] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:33 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:35.068817 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-c72ae834-714a-430d-b69a-a9a07d34aeaf tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:35.069528 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-c72ae834-714a-430d-b69a-a9a07d34aeaf tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:35.075686 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c72ae834-714a-430d-b69a-a9a07d34aeaf tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:35.076175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c72ae834-714a-430d-b69a-a9a07d34aeaf tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:35.076612 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c72ae834-714a-430d-b69a-a9a07d34aeaf tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:35.077335 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c72ae834-714a-430d-b69a-a9a07d34aeaf tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:35.077791 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c72ae834-714a-430d-b69a-a9a07d34aeaf tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:35.078481 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-c72ae834-714a-430d-b69a-a9a07d34aeaf tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:35.158398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-c72ae834-714a-430d-b69a-a9a07d34aeaf tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:35.166727 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-c72ae834-714a-430d-b69a-a9a07d34aeaf tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1210 microversion: 2.1 time: 0.102548 Aug 17 19:53:35.167351 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 485/964] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:35 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:36.080309 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-909cbbaa-046c-4673-8004-0483f18f3be6 req-c3dbdaee-1771-456b-881d-33845f71ac7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46530958-1dc6-4798-8e4d-3d818878686d", "tag": "06bd0f70-436d-4c36-8864-083bf1a2961f"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:53:36.093395 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-909cbbaa-046c-4673-8004-0483f18f3be6 req-c3dbdaee-1771-456b-881d-33845f71ac7d service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:36.093881 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-909cbbaa-046c-4673-8004-0483f18f3be6 req-c3dbdaee-1771-456b-881d-33845f71ac7d service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:36.094312 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-909cbbaa-046c-4673-8004-0483f18f3be6 req-c3dbdaee-1771-456b-881d-33845f71ac7d service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:36.107595 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-909cbbaa-046c-4673-8004-0483f18f3be6 req-c3dbdaee-1771-456b-881d-33845f71ac7d service nova] Creating event network-changed:06bd0f70-436d-4c36-8864-083bf1a2961f for instance 46530958-1dc6-4798-8e4d-3d818878686d on hv-cinder-85069 Aug 17 19:53:36.112670 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-909cbbaa-046c-4673-8004-0483f18f3be6 req-c3dbdaee-1771-456b-881d-33845f71ac7d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036447 Aug 17 19:53:36.113683 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 480/965] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:53:36.187997 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1286b544-721e-4460-b277-84eefdbea3a4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:36.188729 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1286b544-721e-4460-b277-84eefdbea3a4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:36.195264 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1286b544-721e-4460-b277-84eefdbea3a4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:36.195856 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1286b544-721e-4460-b277-84eefdbea3a4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:36.196357 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1286b544-721e-4460-b277-84eefdbea3a4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:36.197117 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1286b544-721e-4460-b277-84eefdbea3a4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:36.197736 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1286b544-721e-4460-b277-84eefdbea3a4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:36.198221 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1286b544-721e-4460-b277-84eefdbea3a4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:36.332888 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1286b544-721e-4460-b277-84eefdbea3a4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:36.341153 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1286b544-721e-4460-b277-84eefdbea3a4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1266 microversion: 2.1 time: 0.157094 Aug 17 19:53:36.341738 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 486/966] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:36 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:37.362492 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c8dbf7da-ce68-46bb-bed6-e90072cf5f48 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:37.363185 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c8dbf7da-ce68-46bb-bed6-e90072cf5f48 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:37.369904 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8dbf7da-ce68-46bb-bed6-e90072cf5f48 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:37.370382 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8dbf7da-ce68-46bb-bed6-e90072cf5f48 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:37.370814 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8dbf7da-ce68-46bb-bed6-e90072cf5f48 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:37.371490 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8dbf7da-ce68-46bb-bed6-e90072cf5f48 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:37.371937 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8dbf7da-ce68-46bb-bed6-e90072cf5f48 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:37.372352 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c8dbf7da-ce68-46bb-bed6-e90072cf5f48 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:37.502675 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c8dbf7da-ce68-46bb-bed6-e90072cf5f48 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:37.510723 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c8dbf7da-ce68-46bb-bed6-e90072cf5f48 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1266 microversion: 2.1 time: 0.152358 Aug 17 19:53:37.511273 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 481/967] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:37 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:38.531163 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-e7ec78ef-15e0-4ce7-8a5e-98ba3158f74b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:38.531717 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-e7ec78ef-15e0-4ce7-8a5e-98ba3158f74b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:38.533949 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:53:38.539166 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e7ec78ef-15e0-4ce7-8a5e-98ba3158f74b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:38.539636 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e7ec78ef-15e0-4ce7-8a5e-98ba3158f74b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:38.540066 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e7ec78ef-15e0-4ce7-8a5e-98ba3158f74b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:38.541276 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e7ec78ef-15e0-4ce7-8a5e-98ba3158f74b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:38.541726 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e7ec78ef-15e0-4ce7-8a5e-98ba3158f74b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:38.542142 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-e7ec78ef-15e0-4ce7-8a5e-98ba3158f74b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:38.672397 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-e7ec78ef-15e0-4ce7-8a5e-98ba3158f74b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:38.680308 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-e7ec78ef-15e0-4ce7-8a5e-98ba3158f74b tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1266 microversion: 2.1 time: 0.153104 Aug 17 19:53:38.680867 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 487/968] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:38 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:39.702282 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c1a9473b-125c-4e99-9449-c0de085999c2 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:39.702909 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c1a9473b-125c-4e99-9449-c0de085999c2 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:39.709580 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c1a9473b-125c-4e99-9449-c0de085999c2 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:39.710069 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c1a9473b-125c-4e99-9449-c0de085999c2 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:39.710509 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c1a9473b-125c-4e99-9449-c0de085999c2 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:39.711206 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c1a9473b-125c-4e99-9449-c0de085999c2 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:39.711662 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c1a9473b-125c-4e99-9449-c0de085999c2 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:39.712089 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c1a9473b-125c-4e99-9449-c0de085999c2 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:39.842070 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c1a9473b-125c-4e99-9449-c0de085999c2 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:39.849445 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c1a9473b-125c-4e99-9449-c0de085999c2 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1266 microversion: 2.1 time: 0.151051 Aug 17 19:53:39.850005 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 482/969] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:39 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:40.870817 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1b39eb37-b2f8-426f-ba71-88ba3f1273fd tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:40.871433 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1b39eb37-b2f8-426f-ba71-88ba3f1273fd tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:40.877854 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1b39eb37-b2f8-426f-ba71-88ba3f1273fd tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:40.878326 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1b39eb37-b2f8-426f-ba71-88ba3f1273fd tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:40.878763 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1b39eb37-b2f8-426f-ba71-88ba3f1273fd tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:40.879449 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1b39eb37-b2f8-426f-ba71-88ba3f1273fd tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:40.879907 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1b39eb37-b2f8-426f-ba71-88ba3f1273fd tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:40.880332 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1b39eb37-b2f8-426f-ba71-88ba3f1273fd tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:41.013171 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1b39eb37-b2f8-426f-ba71-88ba3f1273fd tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:41.021386 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1b39eb37-b2f8-426f-ba71-88ba3f1273fd tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1266 microversion: 2.1 time: 0.154988 Aug 17 19:53:41.021964 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 488/970] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:40 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:53:42.042447 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2dadfce9-9d72-4dca-9cfe-bf52799d3b2e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:42.042990 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2dadfce9-9d72-4dca-9cfe-bf52799d3b2e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:42.045403 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=4 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:53:42.050845 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2dadfce9-9d72-4dca-9cfe-bf52799d3b2e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:42.051321 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2dadfce9-9d72-4dca-9cfe-bf52799d3b2e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:42.051749 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2dadfce9-9d72-4dca-9cfe-bf52799d3b2e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:42.052706 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2dadfce9-9d72-4dca-9cfe-bf52799d3b2e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:42.053159 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2dadfce9-9d72-4dca-9cfe-bf52799d3b2e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:42.053603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2dadfce9-9d72-4dca-9cfe-bf52799d3b2e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:42.180123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-2dadfce9-9d72-4dca-9cfe-bf52799d3b2e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:42.188492 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2dadfce9-9d72-4dca-9cfe-bf52799d3b2e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1266 microversion: 2.1 time: 0.149921 Aug 17 19:53:42.189051 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 483/971] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:42 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:43.208592 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-39bb7c2d-eb0c-4117-bb0c-16a1b7ff5993 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:43.209131 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-39bb7c2d-eb0c-4117-bb0c-16a1b7ff5993 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:43.211486 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=10 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:53:43.217431 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-39bb7c2d-eb0c-4117-bb0c-16a1b7ff5993 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:43.217919 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-39bb7c2d-eb0c-4117-bb0c-16a1b7ff5993 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:43.218351 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-39bb7c2d-eb0c-4117-bb0c-16a1b7ff5993 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:43.219045 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-39bb7c2d-eb0c-4117-bb0c-16a1b7ff5993 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:43.219504 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-39bb7c2d-eb0c-4117-bb0c-16a1b7ff5993 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:43.219928 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-39bb7c2d-eb0c-4117-bb0c-16a1b7ff5993 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:43.347048 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-39bb7c2d-eb0c-4117-bb0c-16a1b7ff5993 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:43.355123 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-39bb7c2d-eb0c-4117-bb0c-16a1b7ff5993 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1266 microversion: 2.1 time: 0.150507 Aug 17 19:53:43.355679 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 489/972] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:43 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:44.375587 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-c4b5daed-b1de-4f2c-a93f-4a42dce23005 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:44.376164 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-c4b5daed-b1de-4f2c-a93f-4a42dce23005 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:44.382516 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c4b5daed-b1de-4f2c-a93f-4a42dce23005 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:44.383000 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c4b5daed-b1de-4f2c-a93f-4a42dce23005 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:44.383433 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c4b5daed-b1de-4f2c-a93f-4a42dce23005 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:44.384120 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c4b5daed-b1de-4f2c-a93f-4a42dce23005 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:44.384575 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c4b5daed-b1de-4f2c-a93f-4a42dce23005 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:44.384998 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-c4b5daed-b1de-4f2c-a93f-4a42dce23005 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:44.514579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-c4b5daed-b1de-4f2c-a93f-4a42dce23005 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:44.522063 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-c4b5daed-b1de-4f2c-a93f-4a42dce23005 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1266 microversion: 2.1 time: 0.150414 Aug 17 19:53:44.522629 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 484/973] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:44 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:45.542548 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-4bbb027b-2694-4198-91b1-ab24cf97f1c4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:45.543167 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-4bbb027b-2694-4198-91b1-ab24cf97f1c4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:45.549554 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4bbb027b-2694-4198-91b1-ab24cf97f1c4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:45.550042 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4bbb027b-2694-4198-91b1-ab24cf97f1c4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:45.550480 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4bbb027b-2694-4198-91b1-ab24cf97f1c4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:45.551179 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4bbb027b-2694-4198-91b1-ab24cf97f1c4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:45.551634 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4bbb027b-2694-4198-91b1-ab24cf97f1c4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:45.552060 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-4bbb027b-2694-4198-91b1-ab24cf97f1c4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:45.686101 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-4bbb027b-2694-4198-91b1-ab24cf97f1c4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:45.693512 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-4bbb027b-2694-4198-91b1-ab24cf97f1c4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1266 microversion: 2.1 time: 0.154803 Aug 17 19:53:45.694085 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 490/974] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:45 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:46.714839 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-eee1951d-9be7-4aab-bb9c-3c53914ca34c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:46.715483 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-eee1951d-9be7-4aab-bb9c-3c53914ca34c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:46.721949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-eee1951d-9be7-4aab-bb9c-3c53914ca34c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:46.722460 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-eee1951d-9be7-4aab-bb9c-3c53914ca34c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:46.722903 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-eee1951d-9be7-4aab-bb9c-3c53914ca34c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:46.723587 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-eee1951d-9be7-4aab-bb9c-3c53914ca34c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:46.724041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-eee1951d-9be7-4aab-bb9c-3c53914ca34c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:46.724462 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-eee1951d-9be7-4aab-bb9c-3c53914ca34c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:46.855019 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-eee1951d-9be7-4aab-bb9c-3c53914ca34c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:46.862387 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-eee1951d-9be7-4aab-bb9c-3c53914ca34c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1266 microversion: 2.1 time: 0.152122 Aug 17 19:53:46.862947 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 485/975] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:46 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:47.248799 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-e0bc9c81-9568-4b2c-83f3-4baf056617e8 req-faf4c62a-e911-4277-a6a6-8b2bec406227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46530958-1dc6-4798-8e4d-3d818878686d", "name": "network-vif-plugged", "status": "completed", "tag": "06bd0f70-436d-4c36-8864-083bf1a2961f"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:53:47.259242 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-e0bc9c81-9568-4b2c-83f3-4baf056617e8 req-faf4c62a-e911-4277-a6a6-8b2bec406227 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:47.259720 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-e0bc9c81-9568-4b2c-83f3-4baf056617e8 req-faf4c62a-e911-4277-a6a6-8b2bec406227 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:47.260151 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-e0bc9c81-9568-4b2c-83f3-4baf056617e8 req-faf4c62a-e911-4277-a6a6-8b2bec406227 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:47.271154 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-e0bc9c81-9568-4b2c-83f3-4baf056617e8 req-faf4c62a-e911-4277-a6a6-8b2bec406227 service nova] Creating event network-vif-plugged:06bd0f70-436d-4c36-8864-083bf1a2961f for instance 46530958-1dc6-4798-8e4d-3d818878686d on hv-cinder-85069 Aug 17 19:53:47.275156 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR oslo.messaging._drivers.impl_rabbit [req-e0bc9c81-9568-4b2c-83f3-4baf056617e8 req-faf4c62a-e911-4277-a6a6-8b2bec406227 service nova] [5c8a3645-0083-48f9-898b-76c6abb4cd34] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 19:53:47.883318 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-006d47a9-ea1b-4395-8041-2dda935a7058 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:47.884540 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-006d47a9-ea1b-4395-8041-2dda935a7058 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:47.890936 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-006d47a9-ea1b-4395-8041-2dda935a7058 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:47.891419 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-006d47a9-ea1b-4395-8041-2dda935a7058 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:47.891854 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-006d47a9-ea1b-4395-8041-2dda935a7058 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:47.892545 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-006d47a9-ea1b-4395-8041-2dda935a7058 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:47.892998 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-006d47a9-ea1b-4395-8041-2dda935a7058 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:47.893449 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-006d47a9-ea1b-4395-8041-2dda935a7058 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:48.020970 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-006d47a9-ea1b-4395-8041-2dda935a7058 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:48.028402 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-006d47a9-ea1b-4395-8041-2dda935a7058 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1266 microversion: 2.1 time: 0.149071 Aug 17 19:53:48.028967 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 486/976] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:47 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:53:48.282423 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO oslo.messaging._drivers.impl_rabbit [req-e0bc9c81-9568-4b2c-83f3-4baf056617e8 req-faf4c62a-e911-4277-a6a6-8b2bec406227 service nova] [5c8a3645-0083-48f9-898b-76c6abb4cd34] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 56584. Aug 17 19:53:48.285723 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-e0bc9c81-9568-4b2c-83f3-4baf056617e8 req-faf4c62a-e911-4277-a6a6-8b2bec406227 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.040822 Aug 17 19:53:48.286318 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 491/977] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:53:49.048617 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d0ba5f4d-ead2-4564-ab75-2f3f1d755c8e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:49.049252 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d0ba5f4d-ead2-4564-ab75-2f3f1d755c8e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:49.055580 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d0ba5f4d-ead2-4564-ab75-2f3f1d755c8e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:49.056063 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d0ba5f4d-ead2-4564-ab75-2f3f1d755c8e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:49.056490 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d0ba5f4d-ead2-4564-ab75-2f3f1d755c8e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:49.057171 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d0ba5f4d-ead2-4564-ab75-2f3f1d755c8e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:49.057646 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d0ba5f4d-ead2-4564-ab75-2f3f1d755c8e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:49.058064 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d0ba5f4d-ead2-4564-ab75-2f3f1d755c8e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:49.190739 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d0ba5f4d-ead2-4564-ab75-2f3f1d755c8e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:49.198628 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d0ba5f4d-ead2-4564-ab75-2f3f1d755c8e tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1266 microversion: 2.1 time: 0.153856 Aug 17 19:53:49.199189 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 487/978] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:49 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:50.220027 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-7a38fdf3-9d84-4744-9747-3e633f2ef0c5 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:50.220634 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-7a38fdf3-9d84-4744-9747-3e633f2ef0c5 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:50.226695 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7a38fdf3-9d84-4744-9747-3e633f2ef0c5 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:50.227169 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7a38fdf3-9d84-4744-9747-3e633f2ef0c5 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:50.228220 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7a38fdf3-9d84-4744-9747-3e633f2ef0c5 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:50.228900 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7a38fdf3-9d84-4744-9747-3e633f2ef0c5 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:50.229369 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7a38fdf3-9d84-4744-9747-3e633f2ef0c5 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:50.229785 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-7a38fdf3-9d84-4744-9747-3e633f2ef0c5 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:50.357711 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-7a38fdf3-9d84-4744-9747-3e633f2ef0c5 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:50.365157 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-7a38fdf3-9d84-4744-9747-3e633f2ef0c5 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1454 microversion: 2.1 time: 0.149949 Aug 17 19:53:50.365744 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 492/979] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:50 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:50.385674 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-72c45113-b889-4a0a-bc2e-8f9f4194bdfa tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:53:50.386288 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-72c45113-b889-4a0a-bc2e-8f9f4194bdfa tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:53:50.392588 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-72c45113-b889-4a0a-bc2e-8f9f4194bdfa tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:50.393142 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-72c45113-b889-4a0a-bc2e-8f9f4194bdfa tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:50.393790 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-72c45113-b889-4a0a-bc2e-8f9f4194bdfa tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:50.394528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-72c45113-b889-4a0a-bc2e-8f9f4194bdfa tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:50.395092 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-72c45113-b889-4a0a-bc2e-8f9f4194bdfa tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:50.395739 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-72c45113-b889-4a0a-bc2e-8f9f4194bdfa tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:50.524169 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-72c45113-b889-4a0a-bc2e-8f9f4194bdfa tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:53:50.532122 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-72c45113-b889-4a0a-bc2e-8f9f4194bdfa tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1454 microversion: 2.1 time: 0.150796 Aug 17 19:53:50.532690 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 488/980] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:53:50 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:53:52.130491 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-028a7dc4-5eb6-4eb9-8f20-609bf01aa217 req-958a9225-40af-43c9-9b75-fa92000bb7a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46530958-1dc6-4798-8e4d-3d818878686d", "tag": "06bd0f70-436d-4c36-8864-083bf1a2961f"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:53:52.140256 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-028a7dc4-5eb6-4eb9-8f20-609bf01aa217 req-958a9225-40af-43c9-9b75-fa92000bb7a1 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:53:52.140743 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-028a7dc4-5eb6-4eb9-8f20-609bf01aa217 req-958a9225-40af-43c9-9b75-fa92000bb7a1 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:53:52.141175 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-028a7dc4-5eb6-4eb9-8f20-609bf01aa217 req-958a9225-40af-43c9-9b75-fa92000bb7a1 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:53:52.152563 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-028a7dc4-5eb6-4eb9-8f20-609bf01aa217 req-958a9225-40af-43c9-9b75-fa92000bb7a1 service nova] Creating event network-changed:06bd0f70-436d-4c36-8864-083bf1a2961f for instance 46530958-1dc6-4798-8e4d-3d818878686d on hv-cinder-85069 Aug 17 19:53:52.157525 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-028a7dc4-5eb6-4eb9-8f20-609bf01aa217 req-958a9225-40af-43c9-9b75-fa92000bb7a1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085235 Aug 17 19:53:52.158466 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 493/981] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:54:12.505012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 19:54:12.505636 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Wed Aug 17 19:54:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 19:54:13.048857 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 19:54:13.049018 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Wed Aug 17 19:54:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 19:55:27.170885 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:27.171896 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:27.177378 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1380247097", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1248518498", "security_groups": [{"name": "tempest-secgroup-smoke-2091540201"}], "block_device_mapping_v2": [{"uuid": "34642500-7448-4e0a-8d19-0294667c70ba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b9833d36-2800-444b-a953-b1f217939327"}]}} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:55:27.385659 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.network.neutron [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] validate_networks() for [('b9833d36-2800-444b-a953-b1f217939327', None, None, None, None, None)] {{(pid=132530) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 19:55:28.028671 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Flavor limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 19:55:28.029089 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Image limits 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 19:55:28.029593 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Flavor pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 19:55:28.029996 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Image pref 0:0:0 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 19:55:28.030617 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.virt.hardware [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132530) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 19:55:28.039733 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:28.040205 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:28.040633 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:28.041384 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:28.041834 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:28.042250 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:28.058240 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Getting quotas for project aff3b32658054cff96939af2ce92fd7b. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 19:55:28.063186 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.quota [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Getting quotas for user 7b632d0e7dc64db79487d1d253c96cda and project aff3b32658054cff96939af2ce92fd7b. Resources: {'cores', 'ram', 'instances'} {{(pid=132530) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 19:55:28.122797 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Going to run 1 instances... {{(pid=132530) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 19:55:28.124862 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='34642500-7448-4e0a-8d19-0294667c70ba',volume_size=None,volume_type=None)] {{(pid=132530) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 19:55:28.250834 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-800b38b3-b80e-4cb3-b0b4-fe5e70bedd41 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.081709 Aug 17 19:55:28.251527 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 489/982] 10.222.0.59 () {60 vars in 1147 bytes} [Wed Aug 17 19:55:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 19:55:28.261290 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55195b0a-2b30-4ca3-ab47-6c9d26789947] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 17 19:55:28.261986 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:28.263158 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=60 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:28.267640 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-d6d195a8-79bc-4ad2-a3cb-afb480888be4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:28.268424 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-d6d195a8-79bc-4ad2-a3cb-afb480888be4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:28.392590 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-d6d195a8-79bc-4ad2-a3cb-afb480888be4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:28.399424 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-d6d195a8-79bc-4ad2-a3cb-afb480888be4 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1095 microversion: 2.1 time: 0.140907 Aug 17 19:55:28.409278 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 494/983] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:28 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1095 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:29.421106 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f6e862fe-f122-44c5-9384-f8d0308af4cb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:29.421895 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f6e862fe-f122-44c5-9384-f8d0308af4cb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:29.427983 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6e862fe-f122-44c5-9384-f8d0308af4cb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:29.428548 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6e862fe-f122-44c5-9384-f8d0308af4cb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:29.429077 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6e862fe-f122-44c5-9384-f8d0308af4cb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:29.429871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6e862fe-f122-44c5-9384-f8d0308af4cb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:29.431041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6e862fe-f122-44c5-9384-f8d0308af4cb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:29.431475 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f6e862fe-f122-44c5-9384-f8d0308af4cb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:29.494668 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f6e862fe-f122-44c5-9384-f8d0308af4cb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:29.502133 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f6e862fe-f122-44c5-9384-f8d0308af4cb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1211 microversion: 2.1 time: 0.085620 Aug 17 19:55:29.502693 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 490/984] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:29 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:30.454246 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [req-bdb65fb2-ba11-4b69-a813-acbe8f6d9ff0 req-88bab894-13c5-4d99-8621-6526ec651e13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df91c29-f4fc-4515-968c-5721a14a9e52", "tag": "478e9e40-944d-433c-aa22-dbd32ea4a9e5"}]} {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:55:30.469619 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-bdb65fb2-ba11-4b69-a813-acbe8f6d9ff0 req-88bab894-13c5-4d99-8621-6526ec651e13 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:30.470104 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-bdb65fb2-ba11-4b69-a813-acbe8f6d9ff0 req-88bab894-13c5-4d99-8621-6526ec651e13 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:30.470538 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [req-bdb65fb2-ba11-4b69-a813-acbe8f6d9ff0 req-88bab894-13c5-4d99-8621-6526ec651e13 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:30.483201 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.compute.server_external_events [req-bdb65fb2-ba11-4b69-a813-acbe8f6d9ff0 req-88bab894-13c5-4d99-8621-6526ec651e13 service nova] Creating event network-changed:478e9e40-944d-433c-aa22-dbd32ea4a9e5 for instance 8df91c29-f4fc-4515-968c-5721a14a9e52 on hv-cinder-85069 Aug 17 19:55:30.487816 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [req-bdb65fb2-ba11-4b69-a813-acbe8f6d9ff0 req-88bab894-13c5-4d99-8621-6526ec651e13 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037597 Aug 17 19:55:30.488508 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 495/985] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:55:30.523472 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d3bd3f68-7efc-4109-85de-8fbd8489e449 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:30.524635 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d3bd3f68-7efc-4109-85de-8fbd8489e449 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:30.530919 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d3bd3f68-7efc-4109-85de-8fbd8489e449 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:30.531409 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d3bd3f68-7efc-4109-85de-8fbd8489e449 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:30.531847 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d3bd3f68-7efc-4109-85de-8fbd8489e449 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:30.532539 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d3bd3f68-7efc-4109-85de-8fbd8489e449 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:30.532992 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d3bd3f68-7efc-4109-85de-8fbd8489e449 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:30.533618 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d3bd3f68-7efc-4109-85de-8fbd8489e449 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:30.665470 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d3bd3f68-7efc-4109-85de-8fbd8489e449 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:30.673646 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d3bd3f68-7efc-4109-85de-8fbd8489e449 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1267 microversion: 2.1 time: 0.154181 Aug 17 19:55:30.674297 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 491/986] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:30 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:31.694908 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-361868f5-5e46-4863-a61a-40f9ebe1fde9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:31.695607 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-361868f5-5e46-4863-a61a-40f9ebe1fde9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:31.697719 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO oslo.messaging._drivers.impl_rabbit [-] [55195b0a-2b30-4ca3-ab47-6c9d26789947] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 56700. Aug 17 19:55:31.703357 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-361868f5-5e46-4863-a61a-40f9ebe1fde9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:31.703837 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-361868f5-5e46-4863-a61a-40f9ebe1fde9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:31.704534 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-361868f5-5e46-4863-a61a-40f9ebe1fde9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:31.705231 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-361868f5-5e46-4863-a61a-40f9ebe1fde9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:31.705686 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-361868f5-5e46-4863-a61a-40f9ebe1fde9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:31.706106 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-361868f5-5e46-4863-a61a-40f9ebe1fde9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:31.833994 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-361868f5-5e46-4863-a61a-40f9ebe1fde9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:31.841479 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-361868f5-5e46-4863-a61a-40f9ebe1fde9 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1267 microversion: 2.1 time: 0.150852 Aug 17 19:55:31.842051 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 496/987] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:31 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:32.861772 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-7c5f4b4b-02ab-4078-827c-85b3f159526c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:32.862371 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-7c5f4b4b-02ab-4078-827c-85b3f159526c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:32.868787 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7c5f4b4b-02ab-4078-827c-85b3f159526c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:32.869309 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7c5f4b4b-02ab-4078-827c-85b3f159526c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:32.869755 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7c5f4b4b-02ab-4078-827c-85b3f159526c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:32.870458 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7c5f4b4b-02ab-4078-827c-85b3f159526c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:32.870906 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7c5f4b4b-02ab-4078-827c-85b3f159526c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:32.871332 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-7c5f4b4b-02ab-4078-827c-85b3f159526c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:33.004313 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-7c5f4b4b-02ab-4078-827c-85b3f159526c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:33.012188 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-7c5f4b4b-02ab-4078-827c-85b3f159526c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1267 microversion: 2.1 time: 0.154320 Aug 17 19:55:33.012743 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 492/988] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:32 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:34.033198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-971f0230-f947-4acf-9c70-9470602db2d0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:34.033830 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-971f0230-f947-4acf-9c70-9470602db2d0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:34.040821 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-971f0230-f947-4acf-9c70-9470602db2d0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:34.041338 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-971f0230-f947-4acf-9c70-9470602db2d0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:34.041777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-971f0230-f947-4acf-9c70-9470602db2d0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:34.042456 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-971f0230-f947-4acf-9c70-9470602db2d0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:34.042907 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-971f0230-f947-4acf-9c70-9470602db2d0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:34.043325 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-971f0230-f947-4acf-9c70-9470602db2d0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:34.181043 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-971f0230-f947-4acf-9c70-9470602db2d0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:34.188814 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-971f0230-f947-4acf-9c70-9470602db2d0 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1267 microversion: 2.1 time: 0.159491 Aug 17 19:55:34.189400 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 497/989] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:34 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:35.209918 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2ce2160f-c705-47a6-932d-4cd54f2076b8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:35.210461 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2ce2160f-c705-47a6-932d-4cd54f2076b8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:35.216829 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2ce2160f-c705-47a6-932d-4cd54f2076b8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:35.217341 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2ce2160f-c705-47a6-932d-4cd54f2076b8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:35.217775 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2ce2160f-c705-47a6-932d-4cd54f2076b8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:35.218461 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2ce2160f-c705-47a6-932d-4cd54f2076b8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:35.218919 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2ce2160f-c705-47a6-932d-4cd54f2076b8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:35.219342 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2ce2160f-c705-47a6-932d-4cd54f2076b8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:35.349700 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-2ce2160f-c705-47a6-932d-4cd54f2076b8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:35.357698 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2ce2160f-c705-47a6-932d-4cd54f2076b8 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1267 microversion: 2.1 time: 0.151778 Aug 17 19:55:35.358256 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 493/990] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:35 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:36.378643 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-1a70db59-6bd8-4a54-a80b-aa508a090cbc tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:36.379213 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-1a70db59-6bd8-4a54-a80b-aa508a090cbc tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:36.386042 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1a70db59-6bd8-4a54-a80b-aa508a090cbc tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:36.386518 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1a70db59-6bd8-4a54-a80b-aa508a090cbc tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:36.386946 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1a70db59-6bd8-4a54-a80b-aa508a090cbc tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:36.387618 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1a70db59-6bd8-4a54-a80b-aa508a090cbc tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:36.388069 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1a70db59-6bd8-4a54-a80b-aa508a090cbc tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:36.388485 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-1a70db59-6bd8-4a54-a80b-aa508a090cbc tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:36.520684 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-1a70db59-6bd8-4a54-a80b-aa508a090cbc tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:36.528009 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-1a70db59-6bd8-4a54-a80b-aa508a090cbc tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1267 microversion: 2.1 time: 0.153403 Aug 17 19:55:36.528566 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 498/991] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:36 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:37.547800 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-1656bf0f-43ec-4f68-af3e-1294f35a93be tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:37.548401 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-1656bf0f-43ec-4f68-af3e-1294f35a93be tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:37.554647 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1656bf0f-43ec-4f68-af3e-1294f35a93be tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:37.555126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1656bf0f-43ec-4f68-af3e-1294f35a93be tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:37.555558 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1656bf0f-43ec-4f68-af3e-1294f35a93be tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:37.556235 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1656bf0f-43ec-4f68-af3e-1294f35a93be tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:37.556682 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1656bf0f-43ec-4f68-af3e-1294f35a93be tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:37.557104 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-1656bf0f-43ec-4f68-af3e-1294f35a93be tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:37.686214 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-1656bf0f-43ec-4f68-af3e-1294f35a93be tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:37.693499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-1656bf0f-43ec-4f68-af3e-1294f35a93be tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1267 microversion: 2.1 time: 0.149546 Aug 17 19:55:37.694050 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 494/992] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:37 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:38.715728 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ffd9f7a4-017b-485d-a306-f1a97ba94a9a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:38.716342 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ffd9f7a4-017b-485d-a306-f1a97ba94a9a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:38.718711 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell0:SELECT=2 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:38.724315 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ffd9f7a4-017b-485d-a306-f1a97ba94a9a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:38.724798 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ffd9f7a4-017b-485d-a306-f1a97ba94a9a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:38.725637 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ffd9f7a4-017b-485d-a306-f1a97ba94a9a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:38.726327 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ffd9f7a4-017b-485d-a306-f1a97ba94a9a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:38.727390 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ffd9f7a4-017b-485d-a306-f1a97ba94a9a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:38.727819 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ffd9f7a4-017b-485d-a306-f1a97ba94a9a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:38.865571 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-ffd9f7a4-017b-485d-a306-f1a97ba94a9a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:38.873303 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ffd9f7a4-017b-485d-a306-f1a97ba94a9a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1267 microversion: 2.1 time: 0.161890 Aug 17 19:55:38.873808 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 499/993] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:38 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:39.893464 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-d247cab5-309c-4eea-acb6-8fbc76681e44 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:39.894084 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-d247cab5-309c-4eea-acb6-8fbc76681e44 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:39.895935 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=2 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:39.896603 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell0:SELECT=6 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:55:39.902968 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d247cab5-309c-4eea-acb6-8fbc76681e44 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:39.903456 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d247cab5-309c-4eea-acb6-8fbc76681e44 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:39.903898 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d247cab5-309c-4eea-acb6-8fbc76681e44 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:39.904590 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d247cab5-309c-4eea-acb6-8fbc76681e44 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:39.905045 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d247cab5-309c-4eea-acb6-8fbc76681e44 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:39.905499 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-d247cab5-309c-4eea-acb6-8fbc76681e44 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:40.036661 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-d247cab5-309c-4eea-acb6-8fbc76681e44 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:40.044755 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-d247cab5-309c-4eea-acb6-8fbc76681e44 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1267 microversion: 2.1 time: 0.155153 Aug 17 19:55:40.045343 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 495/994] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:39 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:41.066173 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-3870d690-1bdd-41bb-84a8-e44b4306fbd3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:41.066793 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-3870d690-1bdd-41bb-84a8-e44b4306fbd3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:41.073786 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3870d690-1bdd-41bb-84a8-e44b4306fbd3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:41.074269 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3870d690-1bdd-41bb-84a8-e44b4306fbd3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:41.074712 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3870d690-1bdd-41bb-84a8-e44b4306fbd3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:41.075398 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3870d690-1bdd-41bb-84a8-e44b4306fbd3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:41.075855 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3870d690-1bdd-41bb-84a8-e44b4306fbd3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:41.076320 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-3870d690-1bdd-41bb-84a8-e44b4306fbd3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:41.202106 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-3870d690-1bdd-41bb-84a8-e44b4306fbd3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:41.209788 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-3870d690-1bdd-41bb-84a8-e44b4306fbd3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1267 microversion: 2.1 time: 0.147594 Aug 17 19:55:41.210353 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 500/995] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:41 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:41.895102 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-4f52c599-8b46-4bb3-9ee3-1e7db94a6ee4 req-dd5aefc4-26e0-44d7-b0cb-b0d3032af0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df91c29-f4fc-4515-968c-5721a14a9e52", "name": "network-vif-plugged", "status": "completed", "tag": "478e9e40-944d-433c-aa22-dbd32ea4a9e5"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:55:41.906423 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-4f52c599-8b46-4bb3-9ee3-1e7db94a6ee4 req-dd5aefc4-26e0-44d7-b0cb-b0d3032af0ec service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:41.906906 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-4f52c599-8b46-4bb3-9ee3-1e7db94a6ee4 req-dd5aefc4-26e0-44d7-b0cb-b0d3032af0ec service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:41.907336 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-4f52c599-8b46-4bb3-9ee3-1e7db94a6ee4 req-dd5aefc4-26e0-44d7-b0cb-b0d3032af0ec service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:41.919182 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-4f52c599-8b46-4bb3-9ee3-1e7db94a6ee4 req-dd5aefc4-26e0-44d7-b0cb-b0d3032af0ec service nova] Creating event network-vif-plugged:478e9e40-944d-433c-aa22-dbd32ea4a9e5 for instance 8df91c29-f4fc-4515-968c-5721a14a9e52 on hv-cinder-85069 Aug 17 19:55:41.924411 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-4f52c599-8b46-4bb3-9ee3-1e7db94a6ee4 req-dd5aefc4-26e0-44d7-b0cb-b0d3032af0ec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032933 Aug 17 19:55:41.925019 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 496/996] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:55:42.231564 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-88baad59-a91f-4412-bb8a-071ba9f769d3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:42.232406 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-88baad59-a91f-4412-bb8a-071ba9f769d3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:42.239361 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-88baad59-a91f-4412-bb8a-071ba9f769d3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:42.239837 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-88baad59-a91f-4412-bb8a-071ba9f769d3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:42.240270 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-88baad59-a91f-4412-bb8a-071ba9f769d3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:42.240952 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-88baad59-a91f-4412-bb8a-071ba9f769d3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:42.241439 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-88baad59-a91f-4412-bb8a-071ba9f769d3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:42.241865 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-88baad59-a91f-4412-bb8a-071ba9f769d3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:42.373989 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-88baad59-a91f-4412-bb8a-071ba9f769d3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:42.381333 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-88baad59-a91f-4412-bb8a-071ba9f769d3 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1267 microversion: 2.1 time: 0.155074 Aug 17 19:55:42.381891 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 501/997] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:42 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:43.403123 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-aed12d96-623c-4804-b32a-336b22444a33 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:43.403829 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-aed12d96-623c-4804-b32a-336b22444a33 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:43.409969 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aed12d96-623c-4804-b32a-336b22444a33 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:43.410454 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aed12d96-623c-4804-b32a-336b22444a33 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:43.410892 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aed12d96-623c-4804-b32a-336b22444a33 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:43.411585 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aed12d96-623c-4804-b32a-336b22444a33 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:43.412044 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aed12d96-623c-4804-b32a-336b22444a33 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:43.412476 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-aed12d96-623c-4804-b32a-336b22444a33 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:43.539346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-aed12d96-623c-4804-b32a-336b22444a33 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:43.546776 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-aed12d96-623c-4804-b32a-336b22444a33 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1455 microversion: 2.1 time: 0.148842 Aug 17 19:55:43.547346 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 497/998] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:43 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:43.566820 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-32ffe9fd-bb39-4a19-829e-4d5ae21f90a6 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:55:43.567432 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-32ffe9fd-bb39-4a19-829e-4d5ae21f90a6 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:55:43.580865 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-32ffe9fd-bb39-4a19-829e-4d5ae21f90a6 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:43.581675 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-32ffe9fd-bb39-4a19-829e-4d5ae21f90a6 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:43.582113 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-32ffe9fd-bb39-4a19-829e-4d5ae21f90a6 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:43.582839 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-32ffe9fd-bb39-4a19-829e-4d5ae21f90a6 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:43.583321 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-32ffe9fd-bb39-4a19-829e-4d5ae21f90a6 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:43.583743 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-32ffe9fd-bb39-4a19-829e-4d5ae21f90a6 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:43.717198 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-32ffe9fd-bb39-4a19-829e-4d5ae21f90a6 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:55:43.724656 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-32ffe9fd-bb39-4a19-829e-4d5ae21f90a6 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1455 microversion: 2.1 time: 0.161761 Aug 17 19:55:43.725236 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 502/999] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:55:43 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:55:45.265414 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-a9deb191-5e1e-4139-8d12-8f05147d4434 req-c644627d-eebe-4821-9079-0d66576d07c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df91c29-f4fc-4515-968c-5721a14a9e52", "tag": "478e9e40-944d-433c-aa22-dbd32ea4a9e5"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:55:45.276279 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-a9deb191-5e1e-4139-8d12-8f05147d4434 req-c644627d-eebe-4821-9079-0d66576d07c2 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:55:45.276756 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-a9deb191-5e1e-4139-8d12-8f05147d4434 req-c644627d-eebe-4821-9079-0d66576d07c2 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:55:45.277188 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-a9deb191-5e1e-4139-8d12-8f05147d4434 req-c644627d-eebe-4821-9079-0d66576d07c2 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:55:45.287949 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-a9deb191-5e1e-4139-8d12-8f05147d4434 req-c644627d-eebe-4821-9079-0d66576d07c2 service nova] Creating event network-changed:478e9e40-944d-433c-aa22-dbd32ea4a9e5 for instance 8df91c29-f4fc-4515-968c-5721a14a9e52 on hv-cinder-85069 Aug 17 19:55:45.293115 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-a9deb191-5e1e-4139-8d12-8f05147d4434 req-c644627d-eebe-4821-9079-0d66576d07c2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031354 Aug 17 19:55:45.293752 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 498/1000] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:55:53.014301 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 19:55:53.014759 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Wed Aug 17 19:55:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 19:57:24.813019 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_api:SELECT=20 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:57:24.814041 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG dbcounter [-] [132531] Writing DB stats nova_cell1:SELECT=44 {{(pid=132531) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:57:24.816013 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:57:24.816755 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG dbcounter [-] [132530] Writing DB stats nova_cell1:SELECT=48 {{(pid=132530) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 19:57:24.819025 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a84ee36b-81aa-4236-8a02-529db2cae711 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:24.819777 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a84ee36b-81aa-4236-8a02-529db2cae711 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:57:24.821262 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-1ed5afea-bceb-4a6d-9c35-cfd56781dc33 req-ac204111-0eb9-44e3-8508-6c3932830f4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df91c29-f4fc-4515-968c-5721a14a9e52", "tag": "478e9e40-944d-433c-aa22-dbd32ea4a9e5"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:57:24.828209 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a84ee36b-81aa-4236-8a02-529db2cae711 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:24.828809 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a84ee36b-81aa-4236-8a02-529db2cae711 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:24.829530 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a84ee36b-81aa-4236-8a02-529db2cae711 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:24.830736 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a84ee36b-81aa-4236-8a02-529db2cae711 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:24.831377 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a84ee36b-81aa-4236-8a02-529db2cae711 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:24.831869 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a84ee36b-81aa-4236-8a02-529db2cae711 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:24.832224 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-1ed5afea-bceb-4a6d-9c35-cfd56781dc33 req-ac204111-0eb9-44e3-8508-6c3932830f4c service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:24.832694 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-1ed5afea-bceb-4a6d-9c35-cfd56781dc33 req-ac204111-0eb9-44e3-8508-6c3932830f4c service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:24.833393 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-1ed5afea-bceb-4a6d-9c35-cfd56781dc33 req-ac204111-0eb9-44e3-8508-6c3932830f4c service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:24.844523 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-1ed5afea-bceb-4a6d-9c35-cfd56781dc33 req-ac204111-0eb9-44e3-8508-6c3932830f4c service nova] Creating event network-changed:478e9e40-944d-433c-aa22-dbd32ea4a9e5 for instance 8df91c29-f4fc-4515-968c-5721a14a9e52 on hv-cinder-85069 Aug 17 19:57:24.849878 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-1ed5afea-bceb-4a6d-9c35-cfd56781dc33 req-ac204111-0eb9-44e3-8508-6c3932830f4c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036056 Aug 17 19:57:24.850842 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 499/1001] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:57:24.858642 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a84ee36b-81aa-4236-8a02-529db2cae711 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:57:24.961258 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a84ee36b-81aa-4236-8a02-529db2cae711 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 204 len: 0 microversion: 2.1 time: 0.149734 Aug 17 19:57:24.968360 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 503/1002] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:57:24 2022] DELETE /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:57:24.973491 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-3ad1bca2-38b8-4be9-ac48-ecbb0b5d801a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:24.974192 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-3ad1bca2-38b8-4be9-ac48-ecbb0b5d801a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:57:24.982510 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3ad1bca2-38b8-4be9-ac48-ecbb0b5d801a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:24.983677 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3ad1bca2-38b8-4be9-ac48-ecbb0b5d801a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:24.984118 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3ad1bca2-38b8-4be9-ac48-ecbb0b5d801a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:24.984817 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3ad1bca2-38b8-4be9-ac48-ecbb0b5d801a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:24.985292 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3ad1bca2-38b8-4be9-ac48-ecbb0b5d801a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:24.985715 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-3ad1bca2-38b8-4be9-ac48-ecbb0b5d801a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:25.122506 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-3ad1bca2-38b8-4be9-ac48-ecbb0b5d801a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:57:25.130953 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-3ad1bca2-38b8-4be9-ac48-ecbb0b5d801a tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1580 microversion: 2.1 time: 0.161597 Aug 17 19:57:25.131528 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 500/1003] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:57:24 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1580 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 19:57:26.152906 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-ce4d5a20-f353-4353-ab42-d0fb10483417 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:26.153763 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-ce4d5a20-f353-4353-ab42-d0fb10483417 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:57:26.159967 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ce4d5a20-f353-4353-ab42-d0fb10483417 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:26.160452 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ce4d5a20-f353-4353-ab42-d0fb10483417 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:26.160889 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ce4d5a20-f353-4353-ab42-d0fb10483417 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:26.161616 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ce4d5a20-f353-4353-ab42-d0fb10483417 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:26.162072 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ce4d5a20-f353-4353-ab42-d0fb10483417 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:26.162525 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-ce4d5a20-f353-4353-ab42-d0fb10483417 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:26.294193 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-ce4d5a20-f353-4353-ab42-d0fb10483417 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:57:26.301978 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-ce4d5a20-f353-4353-ab42-d0fb10483417 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1580 microversion: 2.1 time: 0.153885 Aug 17 19:57:26.302539 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 504/1004] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:57:26 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1580 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:57:27.136109 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-926d7bc2-1ff4-4834-8443-b4635b656897 req-0f1e4c86-69f1-4456-96cd-8d2cb7a2358f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df91c29-f4fc-4515-968c-5721a14a9e52", "name": "network-vif-deleted", "tag": "478e9e40-944d-433c-aa22-dbd32ea4a9e5"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:57:27.145517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-926d7bc2-1ff4-4834-8443-b4635b656897 req-0f1e4c86-69f1-4456-96cd-8d2cb7a2358f service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:27.145994 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-926d7bc2-1ff4-4834-8443-b4635b656897 req-0f1e4c86-69f1-4456-96cd-8d2cb7a2358f service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:27.146417 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-926d7bc2-1ff4-4834-8443-b4635b656897 req-0f1e4c86-69f1-4456-96cd-8d2cb7a2358f service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:27.157777 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-926d7bc2-1ff4-4834-8443-b4635b656897 req-0f1e4c86-69f1-4456-96cd-8d2cb7a2358f service nova] Creating event network-vif-deleted:478e9e40-944d-433c-aa22-dbd32ea4a9e5 for instance 8df91c29-f4fc-4515-968c-5721a14a9e52 on hv-cinder-85069 Aug 17 19:57:27.162545 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-926d7bc2-1ff4-4834-8443-b4635b656897 req-0f1e4c86-69f1-4456-96cd-8d2cb7a2358f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085212 Aug 17 19:57:27.163151 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 501/1005] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:57:27.323792 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-19e8624b-2513-4db8-9522-57ad3a6c39fb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:27.324320 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-19e8624b-2513-4db8-9522-57ad3a6c39fb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:57:27.331383 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-19e8624b-2513-4db8-9522-57ad3a6c39fb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:27.331945 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-19e8624b-2513-4db8-9522-57ad3a6c39fb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:27.332463 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-19e8624b-2513-4db8-9522-57ad3a6c39fb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:27.333248 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-19e8624b-2513-4db8-9522-57ad3a6c39fb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:27.333708 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-19e8624b-2513-4db8-9522-57ad3a6c39fb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:27.334137 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-19e8624b-2513-4db8-9522-57ad3a6c39fb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:27.409948 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-19e8624b-2513-4db8-9522-57ad3a6c39fb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:57:27.418542 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-19e8624b-2513-4db8-9522-57ad3a6c39fb tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 200 len: 1226 microversion: 2.1 time: 0.099208 Aug 17 19:57:27.419206 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 505/1006] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:57:27 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:57:28.440944 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e5d3a1fb-48d7-4ed1-bd62-77a23b1cec72 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:28.441665 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-e5d3a1fb-48d7-4ed1-bd62-77a23b1cec72 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 8df91c29-f4fc-4515-968c-5721a14a9e52] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:57:28.448241 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e5d3a1fb-48d7-4ed1-bd62-77a23b1cec72 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:28.448721 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e5d3a1fb-48d7-4ed1-bd62-77a23b1cec72 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:28.449155 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e5d3a1fb-48d7-4ed1-bd62-77a23b1cec72 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:28.449871 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e5d3a1fb-48d7-4ed1-bd62-77a23b1cec72 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:28.450326 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e5d3a1fb-48d7-4ed1-bd62-77a23b1cec72 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:28.450751 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-e5d3a1fb-48d7-4ed1-bd62-77a23b1cec72 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:28.464509 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-e5d3a1fb-48d7-4ed1-bd62-77a23b1cec72 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] HTTP exception thrown: Instance 8df91c29-f4fc-4515-968c-5721a14a9e52 could not be found. Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e5d3a1fb-48d7-4ed1-bd62-77a23b1cec72 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Request method failure captured: Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 HTTP/1.1 Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UabdxprzT1mV1SFnd5pUkMMXi6qBWZqmzBzYbGDw4nEeVM0fkIrpuBAMRtkgAhPe0ZozFs9cz1yjn-xyDTVWEx5GdBdGW3LPK5MfIKC8Do9rt4whvu2LRYL-BG1_ComuHq8UbzS1TAP2clUY-NkZgeQOLUsckNVT55SeewMGJbpyTU Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: aff3b32658054cff96939af2ce92fd7b Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:57:28.466126 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:57:28.467859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/aff3b32658054cff96939af2ce92fd7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/aff3b32658054cff96939af2ce92fd7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_aff3b32658054cff96939af2ce92fd7b", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/aff3b32658054cff96939af2ce92fd7b"}]}] Aug 17 19:57:28.467859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:57:28.467859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: aff3b32658054cff96939af2ce92fd7b Aug 17 19:57:28.467859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:57:28.467859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-TestVolumeBootPattern-1521606351-project Aug 17 19:57:28.467859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:57:28.467859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:57:28.467859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 7b632d0e7dc64db79487d1d253c96cda Aug 17 19:57:28.467859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-TestVolumeBootPattern-1521606351-project Aug 17 19:57:28.467859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:57:28.467859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 8df91c29-f4fc-4515-968c-5721a14a9e52 could not be found. Aug 17 19:57:28.467859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '8df91c29-f4fc-4515-968c-5721a14a9e52'} Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df91c29-f4fc-4515-968c-5721a14a9e52 could not be found. Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:57:28.469012 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df91c29-f4fc-4515-968c-5721a14a9e52 could not be found. Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df91c29-f4fc-4515-968c-5721a14a9e52 could not be found. Aug 17 19:57:28.470956 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:28.472530 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-e5d3a1fb-48d7-4ed1-bd62-77a23b1cec72 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Returning 404 to user: Instance 8df91c29-f4fc-4515-968c-5721a14a9e52 could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:57:28.472530 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-e5d3a1fb-48d7-4ed1-bd62-77a23b1cec72 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52" status: 404 len: 111 microversion: 2.1 time: 0.031281 Aug 17 19:57:28.472530 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 502/1007] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:57:28 2022] GET /compute/v2.1/servers/8df91c29-f4fc-4515-968c-5721a14a9e52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:57:31.734308 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-a2870375-194d-4cbd-bf05-a8d00a7d35de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:31.734790 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a2870375-194d-4cbd-bf05-a8d00a7d35de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:57:31.736950 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-ca209c95-f493-414a-b12c-90127fdc428a req-0726cfe0-4f4d-498d-a2d6-031b742daba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46530958-1dc6-4798-8e4d-3d818878686d", "tag": "06bd0f70-436d-4c36-8864-083bf1a2961f"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:57:31.741044 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2870375-194d-4cbd-bf05-a8d00a7d35de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:31.741628 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2870375-194d-4cbd-bf05-a8d00a7d35de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:31.742124 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2870375-194d-4cbd-bf05-a8d00a7d35de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:31.742882 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2870375-194d-4cbd-bf05-a8d00a7d35de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:31.743397 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2870375-194d-4cbd-bf05-a8d00a7d35de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:31.744688 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-a2870375-194d-4cbd-bf05-a8d00a7d35de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:31.747579 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-ca209c95-f493-414a-b12c-90127fdc428a req-0726cfe0-4f4d-498d-a2d6-031b742daba4 service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:31.748059 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-ca209c95-f493-414a-b12c-90127fdc428a req-0726cfe0-4f4d-498d-a2d6-031b742daba4 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:31.748489 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-ca209c95-f493-414a-b12c-90127fdc428a req-0726cfe0-4f4d-498d-a2d6-031b742daba4 service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:31.762054 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-ca209c95-f493-414a-b12c-90127fdc428a req-0726cfe0-4f4d-498d-a2d6-031b742daba4 service nova] Creating event network-changed:06bd0f70-436d-4c36-8864-083bf1a2961f for instance 46530958-1dc6-4798-8e4d-3d818878686d on hv-cinder-85069 Aug 17 19:57:31.767507 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-ca209c95-f493-414a-b12c-90127fdc428a req-0726cfe0-4f4d-498d-a2d6-031b742daba4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034347 Aug 17 19:57:31.768112 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 503/1008] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:57:31.770170 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-a2870375-194d-4cbd-bf05-a8d00a7d35de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Going to try to terminate instance {{(pid=132531) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 19:57:31.857442 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-a2870375-194d-4cbd-bf05-a8d00a7d35de tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "DELETE /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 204 len: 0 microversion: 2.1 time: 0.126608 Aug 17 19:57:31.857921 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 506/1009] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:57:31 2022] DELETE /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 19:57:31.867025 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-f31309b5-64a2-4e64-9fc2-beee1036c443 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:31.867746 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-f31309b5-64a2-4e64-9fc2-beee1036c443 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:57:31.874547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f31309b5-64a2-4e64-9fc2-beee1036c443 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:31.875034 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f31309b5-64a2-4e64-9fc2-beee1036c443 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:31.875472 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f31309b5-64a2-4e64-9fc2-beee1036c443 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:31.876170 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f31309b5-64a2-4e64-9fc2-beee1036c443 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:31.876620 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f31309b5-64a2-4e64-9fc2-beee1036c443 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:31.877041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-f31309b5-64a2-4e64-9fc2-beee1036c443 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:32.019036 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.policy [None req-f31309b5-64a2-4e64-9fc2-beee1036c443 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132530) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:57:32.027631 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-f31309b5-64a2-4e64-9fc2-beee1036c443 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1579 microversion: 2.1 time: 0.164971 Aug 17 19:57:32.028202 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 504/1010] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:57:31 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1579 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:57:33.049888 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-9ed4cdc1-2b1b-43a8-a6f4-25a348ff20f7 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:33.050595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-9ed4cdc1-2b1b-43a8-a6f4-25a348ff20f7 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:57:33.056763 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 19:57:33.057284 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Wed Aug 17 19:57:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 19:57:33.057401 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9ed4cdc1-2b1b-43a8-a6f4-25a348ff20f7 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:33.057505 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9ed4cdc1-2b1b-43a8-a6f4-25a348ff20f7 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:33.057943 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9ed4cdc1-2b1b-43a8-a6f4-25a348ff20f7 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:33.058647 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9ed4cdc1-2b1b-43a8-a6f4-25a348ff20f7 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:33.059162 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9ed4cdc1-2b1b-43a8-a6f4-25a348ff20f7 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:33.059517 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-9ed4cdc1-2b1b-43a8-a6f4-25a348ff20f7 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:33.189558 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-9ed4cdc1-2b1b-43a8-a6f4-25a348ff20f7 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:57:33.197682 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-9ed4cdc1-2b1b-43a8-a6f4-25a348ff20f7 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1579 microversion: 2.1 time: 0.151484 Aug 17 19:57:33.198254 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 507/1011] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:57:33 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1579 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:57:33.850859 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [req-41e95d99-4789-41c4-bd3e-f1661547b3dd req-3f6fc3fb-b875-4195-bb31-2537fe357e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46530958-1dc6-4798-8e4d-3d818878686d", "name": "network-vif-deleted", "tag": "06bd0f70-436d-4c36-8864-083bf1a2961f"}]} {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 19:57:33.861164 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-41e95d99-4789-41c4-bd3e-f1661547b3dd req-3f6fc3fb-b875-4195-bb31-2537fe357e3d service nova] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:33.861716 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-41e95d99-4789-41c4-bd3e-f1661547b3dd req-3f6fc3fb-b875-4195-bb31-2537fe357e3d service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:33.862115 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [req-41e95d99-4789-41c4-bd3e-f1661547b3dd req-3f6fc3fb-b875-4195-bb31-2537fe357e3d service nova] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:33.873966 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.compute.server_external_events [req-41e95d99-4789-41c4-bd3e-f1661547b3dd req-3f6fc3fb-b875-4195-bb31-2537fe357e3d service nova] Creating event network-vif-deleted:06bd0f70-436d-4c36-8864-083bf1a2961f for instance 46530958-1dc6-4798-8e4d-3d818878686d on hv-cinder-85069 Aug 17 19:57:33.879001 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [req-41e95d99-4789-41c4-bd3e-f1661547b3dd req-3f6fc3fb-b875-4195-bb31-2537fe357e3d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031970 Aug 17 19:57:33.879616 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 505/1012] 10.222.0.59 () {64 vars in 1317 bytes} [Wed Aug 17 19:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 19:57:34.219543 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:34.220271 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:57:34.227180 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:34.227761 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:34.228314 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:34.229665 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:34.230197 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:34.230717 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:34.265724 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:34.266184 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:34.266655 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:34.267096 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.objects.instance [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lazy-loading 'fault' on Instance uuid 46530958-1dc6-4798-8e4d-3d818878686d {{(pid=132531) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 19:57:34.307225 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.policy [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b632d0e7dc64db79487d1d253c96cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff3b32658054cff96939af2ce92fd7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132531) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 19:57:34.314654 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-5d539647-5871-4327-81c1-5e935fa4bd02 tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 200 len: 1230 microversion: 2.1 time: 0.099099 Aug 17 19:57:34.315213 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 508/1013] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:57:34 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 19:57:35.336928 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2588f87f-4672-4f48-9840-52784de4aa8d tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:35.338191 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-2588f87f-4672-4f48-9840-52784de4aa8d tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 46530958-1dc6-4798-8e4d-3d818878686d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:57:35.344213 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2588f87f-4672-4f48-9840-52784de4aa8d tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:35.344697 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2588f87f-4672-4f48-9840-52784de4aa8d tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:35.345132 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2588f87f-4672-4f48-9840-52784de4aa8d tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:35.345850 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2588f87f-4672-4f48-9840-52784de4aa8d tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:35.346304 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2588f87f-4672-4f48-9840-52784de4aa8d tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:35.346735 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-2588f87f-4672-4f48-9840-52784de4aa8d tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:35.359826 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-2588f87f-4672-4f48-9840-52784de4aa8d tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] HTTP exception thrown: Instance 46530958-1dc6-4798-8e4d-3d818878686d could not be found. Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2588f87f-4672-4f48-9840-52784de4aa8d tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Request method failure captured: Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d HTTP/1.1 Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UabdxprzT1mV1SFnd5pUkMMXi6qBWZqmzBzYbGDw4nEeVM0fkIrpuBAMRtkgAhPe0ZozFs9cz1yjn-xyDTVWEx5GdBdGW3LPK5MfIKC8Do9rt4whvu2LRYL-BG1_ComuHq8UbzS1TAP2clUY-NkZgeQOLUsckNVT55SeewMGJbpyTU Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: aff3b32658054cff96939af2ce92fd7b Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:57:35.361517 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:57:35.363160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/aff3b32658054cff96939af2ce92fd7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/aff3b32658054cff96939af2ce92fd7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_aff3b32658054cff96939af2ce92fd7b", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/aff3b32658054cff96939af2ce92fd7b"}]}] Aug 17 19:57:35.363160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:57:35.363160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: aff3b32658054cff96939af2ce92fd7b Aug 17 19:57:35.363160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:57:35.363160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-TestVolumeBootPattern-1521606351-project Aug 17 19:57:35.363160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:57:35.363160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:57:35.363160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 7b632d0e7dc64db79487d1d253c96cda Aug 17 19:57:35.363160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-TestVolumeBootPattern-1521606351-project Aug 17 19:57:35.363160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:57:35.363160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 46530958-1dc6-4798-8e4d-3d818878686d could not be found. Aug 17 19:57:35.363160 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '46530958-1dc6-4798-8e4d-3d818878686d'} Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46530958-1dc6-4798-8e4d-3d818878686d could not be found. Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:57:35.364219 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46530958-1dc6-4798-8e4d-3d818878686d could not be found. Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46530958-1dc6-4798-8e4d-3d818878686d could not be found. Aug 17 19:57:35.365884 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.367352 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-2588f87f-4672-4f48-9840-52784de4aa8d tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Returning 404 to user: Instance 46530958-1dc6-4798-8e4d-3d818878686d could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:57:35.367352 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-2588f87f-4672-4f48-9840-52784de4aa8d tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d" status: 404 len: 111 microversion: 2.1 time: 0.030895 Aug 17 19:57:35.367352 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 506/1014] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:57:35 2022] GET /compute/v2.1/servers/46530958-1dc6-4798-8e4d-3d818878686d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:57:35.794684 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b4255033-ad7d-47ed-8054-00b2bfdce75c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:35.795193 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.compute.api [None req-b4255033-ad7d-47ed-8054-00b2bfdce75c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132531) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:57:35.801647 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b4255033-ad7d-47ed-8054-00b2bfdce75c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:35.802137 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b4255033-ad7d-47ed-8054-00b2bfdce75c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:35.802595 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b4255033-ad7d-47ed-8054-00b2bfdce75c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:35.803265 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b4255033-ad7d-47ed-8054-00b2bfdce75c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:35.803718 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b4255033-ad7d-47ed-8054-00b2bfdce75c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:35.804141 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG oslo_concurrency.lockutils [None req-b4255033-ad7d-47ed-8054-00b2bfdce75c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132531) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:35.817930 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.wsgi [None req-b4255033-ad7d-47ed-8054-00b2bfdce75c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] HTTP exception thrown: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b4255033-ad7d-47ed-8054-00b2bfdce75c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Request method failure captured: Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: request: DELETE /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d HTTP/1.1 Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept: application/json Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Accept-Encoding: identity Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Connection: close Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Length: 0 Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Content-Type: application/json Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Host: 10.222.0.59 Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Openstack-System-Scope: None Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: User-Agent: python-urllib3/1.26.11 Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Auth-Token: gAAAAABi_UabdxprzT1mV1SFnd5pUkMMXi6qBWZqmzBzYbGDw4nEeVM0fkIrpuBAMRtkgAhPe0ZozFs9cz1yjn-xyDTVWEx5GdBdGW3LPK5MfIKC8Do9rt4whvu2LRYL-BG1_ComuHq8UbzS1TAP2clUY-NkZgeQOLUsckNVT55SeewMGJbpyTU Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Id: None Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Domain-Name: None Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Identity-Status: Confirmed Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Is-Admin-Project: True Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Id: default Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Domain-Name: Default Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Id: aff3b32658054cff96939af2ce92fd7b Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Project-Name: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Role: member,reader Aug 17 19:57:35.819697 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Roles: member,reader Aug 17 19:57:35.821440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/aff3b32658054cff96939af2ce92fd7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/aff3b32658054cff96939af2ce92fd7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_aff3b32658054cff96939af2ce92fd7b", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/aff3b32658054cff96939af2ce92fd7b"}]}] Aug 17 19:57:35.821440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:57:35.821440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Id: aff3b32658054cff96939af2ce92fd7b Aug 17 19:57:35.821440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-Tenant-Name: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:57:35.821440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User: tempest-TestVolumeBootPattern-1521606351-project Aug 17 19:57:35.821440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Id: default Aug 17 19:57:35.821440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Domain-Name: Default Aug 17 19:57:35.821440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Id: 7b632d0e7dc64db79487d1d253c96cda Aug 17 19:57:35.821440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: X-User-Name: tempest-TestVolumeBootPattern-1521606351-project Aug 17 19:57:35.821440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: method: > Aug 17 19:57:35.821440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: exception: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:57:35.821440 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: action_args: {'id': '812369db-d8e2-4ad9-9f0f-044a9589c89d'} Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:57:35.823108 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:57:35.824630 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.826414 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-b4255033-ad7d-47ed-8054-00b2bfdce75c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Returning 404 to user: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. {{(pid=132531) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:57:35.826414 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-b4255033-ad7d-47ed-8054-00b2bfdce75c tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "DELETE /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 404 len: 111 microversion: 2.1 time: 0.030258 Aug 17 19:57:35.826414 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 509/1015] 10.222.0.59 () {58 vars in 1239 bytes} [Wed Aug 17 19:57:35 2022] DELETE /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 19:57:35.831368 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a6a8a8be-3371-4eaf-8b5a-1b280b243c2f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '>' {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:35.832066 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.compute.api [None req-a6a8a8be-3371-4eaf-8b5a-1b280b243c2f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] [instance: 812369db-d8e2-4ad9-9f0f-044a9589c89d] Fetching instance by UUID {{(pid=132530) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 19:57:35.837967 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a6a8a8be-3371-4eaf-8b5a-1b280b243c2f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:35.838450 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a6a8a8be-3371-4eaf-8b5a-1b280b243c2f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:35.838914 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a6a8a8be-3371-4eaf-8b5a-1b280b243c2f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:35.839611 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a6a8a8be-3371-4eaf-8b5a-1b280b243c2f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Acquiring lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 19:57:35.840067 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a6a8a8be-3371-4eaf-8b5a-1b280b243c2f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 19:57:35.840491 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG oslo_concurrency.lockutils [None req-a6a8a8be-3371-4eaf-8b5a-1b280b243c2f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Lock "c9e86fb0-ea6e-4db7-9df6-b28f7ac618fc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132530) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 19:57:35.853547 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.wsgi [None req-a6a8a8be-3371-4eaf-8b5a-1b280b243c2f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] HTTP exception thrown: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a6a8a8be-3371-4eaf-8b5a-1b280b243c2f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Request method failure captured: Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: request: GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d HTTP/1.1 Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept: application/json Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Accept-Encoding: identity Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Connection: close Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Length: 0 Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Content-Type: application/json Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Host: 10.222.0.59 Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Openstack-System-Scope: None Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: User-Agent: python-urllib3/1.26.11 Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Auth-Token: gAAAAABi_UabdxprzT1mV1SFnd5pUkMMXi6qBWZqmzBzYbGDw4nEeVM0fkIrpuBAMRtkgAhPe0ZozFs9cz1yjn-xyDTVWEx5GdBdGW3LPK5MfIKC8Do9rt4whvu2LRYL-BG1_ComuHq8UbzS1TAP2clUY-NkZgeQOLUsckNVT55SeewMGJbpyTU Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Id: None Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Domain-Name: None Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Identity-Status: Confirmed Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Is-Admin-Project: True Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Id: default Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Domain-Name: Default Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Id: aff3b32658054cff96939af2ce92fd7b Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Project-Name: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Role: member,reader Aug 17 19:57:35.855041 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Roles: member,reader Aug 17 19:57:35.856557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/aff3b32658054cff96939af2ce92fd7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/aff3b32658054cff96939af2ce92fd7b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_aff3b32658054cff96939af2ce92fd7b", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/aff3b32658054cff96939af2ce92fd7b"}]}] Aug 17 19:57:35.856557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:57:35.856557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Id: aff3b32658054cff96939af2ce92fd7b Aug 17 19:57:35.856557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-Tenant-Name: tempest-TestVolumeBootPattern-1521606351 Aug 17 19:57:35.856557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User: tempest-TestVolumeBootPattern-1521606351-project Aug 17 19:57:35.856557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Id: default Aug 17 19:57:35.856557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Domain-Name: Default Aug 17 19:57:35.856557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Id: 7b632d0e7dc64db79487d1d253c96cda Aug 17 19:57:35.856557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: X-User-Name: tempest-TestVolumeBootPattern-1521606351-project Aug 17 19:57:35.856557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: method: > Aug 17 19:57:35.856557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: exception: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:57:35.856557 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: action_args: {'id': '812369db-d8e2-4ad9-9f0f-044a9589c89d'} Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: {{(pid=132530) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 19:57:35.857406 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. Aug 17 19:57:35.858691 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: ERROR nova.api.openstack.wsgi Aug 17 19:57:35.859834 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: DEBUG nova.api.openstack.wsgi [None req-a6a8a8be-3371-4eaf-8b5a-1b280b243c2f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Returning 404 to user: Instance 812369db-d8e2-4ad9-9f0f-044a9589c89d could not be found. {{(pid=132530) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 19:57:35.859834 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO nova.api.openstack.requestlog [None req-a6a8a8be-3371-4eaf-8b5a-1b280b243c2f tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d" status: 404 len: 111 microversion: 2.1 time: 0.029186 Aug 17 19:57:35.859834 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: [pid: 132530|app: 0|req: 507/1016] 10.222.0.59 () {58 vars in 1236 bytes} [Wed Aug 17 19:57:35 2022] GET /compute/v2.1/servers/812369db-d8e2-4ad9-9f0f-044a9589c89d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 19:57:37.154394 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: DEBUG nova.api.openstack.wsgi [None req-904b5ca1-3cbf-40b6-a36e-7c5b4bf2a5ee tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] Calling method '.version_select at 0x7f368a085af0>' {{(pid=132531) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 19:57:37.178628 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO nova.api.openstack.requestlog [None req-904b5ca1-3cbf-40b6-a36e-7c5b4bf2a5ee tempest-TestVolumeBootPattern-1521606351 tempest-TestVolumeBootPattern-1521606351-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1248518498" status: 202 len: 0 microversion: 2.1 time: 0.028067 Aug 17 19:57:37.179136 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: [pid: 132531|app: 0|req: 510/1017] 10.222.0.59 () {58 vars in 1263 bytes} [Wed Aug 17 19:57:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1248518498 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 19:59:16.711990 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 19:59:16.712739 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Wed Aug 17 19:59:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:00:52.516788 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:00:52.517404 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Wed Aug 17 20:00:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:00:53.024167 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:00:53.025120 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Wed Aug 17 20:00:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:00:53.066106 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:00:53.066273 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Wed Aug 17 20:00:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:02:36.720042 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:02:36.720620 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Wed Aug 17 20:02:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:02:49.025374 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:02:49.025857 dv-cinder-850698-2-iscsi devstack@n-api.service[132530]: Wed Aug 17 20:02:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:02:51.478672 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:02:51.479226 dv-cinder-850698-2-iscsi devstack@n-api.service[132531]: Wed Aug 17 20:02:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!